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THEME 


With  continuing  growth  in  system  cost  and  complexity,  simulation  Is  becoming 
increasingly  important  to  the  military  and  civilian  communities  as  a  tool  for  design  and 
evaluation  of  complex  processes  and  systems.  Among  its  uses  are  comparison  of 
competing  system  concepts  and  architectures,  prediction  of  system  performance, 
optimization  of  system  responses,  analysis  and  verification  of  system  designs,  training  of 
individuals  and  teams,  and  assessment  of  man-machine  system  performance.  Because  of  its 
growing  use  and  application  to  avionics  systems  and  C3  systems  associated  with  airborne 
operations,  the  Avionics  Panel  of  AGARI)  decided  to  devote  its  38th  Technical  Meeting 
to  a  Symposium  on  this  important  subject. 

Modeling  and  simulation  of  avionics  and  C3  systems  are  heavily  based  on  physical 
sciences,  computer  science,  mathematics,  and  probability  theory;  yet  the  process  of  model 
development  and  experimentation  is  still  very  much  an  Intuitive  art.  In  contrast  to  manned 
simulators,  the  more  complex  system  models  tend  to  be  "grown"  rather  than  specified 
beforehand.  In  order  to  obtain  favorable  cost-benefits  and  effective  utilization  of  any 
simulation,  appropriate  methodologies  for  development  and  implementation  need  to  be 
established,  application  histories  analyzed  and  lessons  derived,  and  the  economics  of  the 
simulation  better  understood.'  In  recognition  of  these  needs,  this  Symposium  addressed 
simulation  techniques  and  their  applications  to  avionics  and  C3  systems  associated  with 
airborne  operations, 

The  program  opened  with  a  one-day  tutorial  session  on  simulation.  The  remainder 
of  the  symposium  covered:  modeling  methodology,  experimentation,  validation,  and 
applications.  Emphasis  was  on  Avionics  and  Airborne  Commund  and  Control,  with 
papers  covering  the  range  from  large-scale  force-effectiveness  and  air  defense  simulations 
through  flight  simulators  and  real-time  avionics  simulations. 
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The  38th  Technical  Meeting  of  the  Avionics  Panel  of  AGARD  was  held  in  Paris,  France,  15-19  October 
1979,  The  theme  of  the  meeting  was  "Modeling  and  Simulation  of  Avionics  Systems  and  Command,  Control, 
and  Communication.!  Syetams."  Forty  papers  were  presented  in  six  sessions.  Tha  program  included  tutorials 
on  simulation  languages,  validation  methods,  and  computer  representation  of  human  decisionmaking!  des¬ 
criptions  of  large-scale  comnand  and  control  and  air  defense  simulations ;  and  new  techniques  in  conmuniea- 
tions,  avionics,  and  flight  simulation,  A  number  of  cbbo  study  applications  were  presented,  including  a 
complete  series  on  uses  of  simulation  in  the  deveiopment  programs  for  large  airborne  surveillance  systems. 

Several  important  issues  emerged  from  the  meeting.  I  have  tried  to  set  them  down  in  a  reasonable 
order,  although  they  seem  to  be  somewhat  Interdependent. 


Programming  Languages 

By  actual  count  at  the  meeting,  the  favorite  by  fur  is  still  FORTRAN;  applications  of  event-based 
general-purpose  simulation  languages  such  as  GASP,  SIMULA,  and  SIMSCRIPT  to  C3  and  avionics  system 
modeling  are  still  few  and  far  between.  One  might  well  ask  why  this  is  so  in  the  face  of  greater 
efficiency  and  ease  of  programming  advertised  for  these  languages.  The  primary  reasons  appear  to  be 
"transferability"  and  "inertia" j  people  who  are  doing  C3  and  avionics  system  modeling  tend  to  be  more 
familiar  and  hence  more  comfortabla  with  FORTRAN  and  can  utilize  each  other's  subroutines.  The  trend 
toward  "man-ln-the-loop"  simulations  (see  below)  imposes  severe  interrupt  requirements  to  provide  for 
the  necessary  man-computer  interaction.  These  requirements  can  easily  be  met  through  FORTRAN  programming! 
however,  modification  to  some  of  the  other  simulation  languages -may  be  required  in  order  to  provide  this 
capability. 


General  Purpose  vs.  Special  Purpose  Simulations 

Very  few  of  the  papers  described  what  might  be  termed  general-purposa  simulation  tools  for  generic 
applications.  To  the  contrary,  nearly  all  involved  special-purpose  simulations  which  could  not  easily 
be  reconfigured  to  represent  new  capabilities  or  to  Answer  a  naw  sat  of  questions.  For  example,  none  of 
the  air  defense  simulations  described  had  the  capability  for  explicitly  representing  the  problem  of 
uncertainty  in  aircraft  identification  and  the  resulting  impact  on  fratricide.  On  the  other  hand  the 
simulation  described  in  Paper  No.  28  la  easily  reconfigurable ,  and  is  applicable  to  a  wide  range  of 
communications  problems  over  a  wide  range  of  environments,  communications  media,  and  systems  approaches. 
Such  a  "building  black"  simulation  la  sorely  needed  for  command  and  control. 


Limits  to  Large-Scale  Models 

We  seem  to  be  approaching  some  sort  of  practical  limit  to  the  utility  of  what  might  be  called  the 
centralized  or  monolithic  model;  i.e.,  one  which  is  totally  self-contained  in  a  single  computer  program 
on  a  Blngle  computer.  Several  of  tha  papers  on  C3  systems,  especially  those  In  Sessions  I  and  II  dealing 
with  command  and  control  for  air  defense,  suggest  an  approach  to  this  limit  in  one  form  or  another t  The 
greater  the  complexity  of  thB  model,  the  greater  the  difficulty  in  understanding  the  model  end  the  results, 
the  greater  the  run  time,  and  the  greater  the  difficulty  of  verification,  validation,  and  configuration 
control.  Higher-speed,  larger-memory  computers  and  novel  use  of  graphic  displays  for  input  and  output 
assistance  and  analysis  may  provide  only  minor  and  temporary  extensionu  of  this  limit.  These  concerns 
lead  to  the  concept  of  a  "distributed  model."  Paper  No.  32  described  such  an  approach,  in  which  a  number 
of  separata  processors  are  programmed  to  simulate  specific  C3  and/or  avionics  functions.  Tills  arrsngement 
permits  asch  "submodel"  to  be  separately  validated  and  verified,  and  for  the  submodel  interactions  to  be 
similarly  tested.  Timing,  sequencing  and  protocol  problems  are  being  handled  by  bus  techniques  sb  in 
current  actual  distributed  systems,  but  there  are  some  problems.  This  concept  of  a  "distributed  (model," 
if  successful,  would  be  useful  in  distributing  the  model-development  load;  separate  groups  or  organizations 
could  more  easily  cooperate  in  building  and  Improving  various  partB  of  the  model,  requiring  only  that 
certain  interoperability  standards  be  rigidly  followed,  Finally,  such  a  model  might  help  stimulate 
research  into  such  questions  as  the  comparative  survivability  of  distributed  C3  systems. 
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Application  of  Experimental  Design  Methods  to  Reduce  Simulation  Runs 

During  the  meeting  it  was  pointed  out  that  a  simulation  involving  100  variables  and  only  2  values 
of  each  variable  would  require  210()  rune  and  several  centuries  for  an  exhaustive  search  of  the  "simulation 
space."  But  Bocial  scientists  for  decades  have  been  dealing  with  this  need  to  collapse  the  measurement 
problem  and  have  ueveloped  very  powerful  sampling  techniques  (e.g. ,  Latin  Square  design)  for  this  purpose. 
Yet  those  methods  apparently  are  almost  unknown  in  the  world  of  simulation. 
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Man-ln-the-Loop  Simulations 

Existing  simulations  appear  to  have  high  resolution  end  validity  in  simulating  the  "control"  side  of 
comnand  and  control  but  low  resolution  and  validity  in  representing  the  "command"  side.  Perhaps  this  is 
so  because  we  do  not  fully  understand  human  activities  in  C3  systems,  especially  the  decisionmaking 
processes  Involved  in  such  functions  as  intelligence  correlation  and  fusion,  apportionment,  allocation, 
assignment,  and  targeting  (see  below).  For  this  reason  wc  seem  to  be  returning  to  a  man- ip- the- loop 
approach  to  simulation  of  C3  systems.  Such  an  approach  involves  a  cycle  of  activities  (Including  simu¬ 
lated  battles)  which  take  place  in  speednd-time  followed  by  a  period  during  which  time  is  "stopped"  and 
information  made  available  to  a  human  for  decision  purposes.  The  decisionmaker  then  develops  or  selects 
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an  action,  arranges  for  Its  execution,  and  the  cycle  repeats.  This  approach  la  gaining  advocacy  both  In 
the  United  States  and  In  Europe.  It  will  certainly  facilitate  the  study  of  decisionmaking  In  command 
and  control;  Indeed,  such  facility  may  well  be  the  most  significant  result  of  these  efforts. 


Human  Decisionmaking 

By  far  the  liveliest  and  longest  discussion  of  the  symposium  centared  around  the  eubject  of  repre¬ 
senting  human  though  processes  In  command  and  control,  this  discussion,  stimulated  by  Paper  Mo.  5, 
brought  out  several  key  Issues; 

a  Alternative  C3  System  architectures  result  in  alternative  partitionings  of  C3  functions, 
possibly  with  associated  differences  In  decision  effectiveness. 

e  Since  decisionmaking  in  C3  systems  tends  to  be  diatrlbuted,  some  architectures  may  Improve 
decision  performance  and  others  may  make  it  worse. 

e  Desirability  of  centralization  at  higher  levels  vs.  increased  delegation  to  lower  levels 
and  aseociated  questions  of  C3  system  design  to  support  one  or  the  other  approach  cannot 
be  answered  without  a  better  understanding  of  the  decision  process  Itself. 

e  To  develop  such  an  understanding,  total  system  simulation  Is  required,  This  must  Incorporate 
a  high  fidelity  combat  environment  to  "drive"  the  cognitive  processes,  and  either  actual 
man- in- the- loop  or  ulmulated  representations  of  human  decisionmaking  ualng  decision  logic 
and/or  artificial  intelligence  techniques. 

e  Man-ln-the-loop  studies  are  required  to  Identify  protocols  and  decision  algorithms  for 
simulation  by  computer. 

The  way  in  which  these  issues  are  addressed  over  the  next  few  years  will  almost  certainly  have  a  major 
Impact  on  future  command,  control,  conmunication*  and  avionlca  systems  development. 


Recommendation 


In  summary,  the  meeting  provided  an  excellent  forum  for  interested  nations  to  exchange  Information 
on  the  current  state-of-the-art  in  modeling  end  simulation  of  avionic*  systems  and  command,  control  and 
communications  aystams.  In  recognition  of  the  emerging  issues  noted  above,  it  is  recommended  thst  another 
similar  masting  ba  hald  in  2  or  3  yeara.  While  many  of  tha  concapta  discussed  in  this  meeting  will  have 
been  further  developed,  simulation  and  modeling  in  arete  eueh  es  new  systems  architecture  concepts,  commend 
snd  control  for  cruiBe  missiles,  and  high-density  air/land  battle  management  may  provide  new  topic*  for 
discussion. 
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Introduotlon 

Last  Spring,  Joa  Wohl  aalead  that  1  provlda  a  few  opaning  rsaarka  for  this  38th  taohnloal  Boating  of  tha 
Avionloa  Panal.  I'm  dallghtad  at  this  opportunity  to  ahars  a  raw  thoughts  about  a  vary  oosplax  aubjaot. 
Ovar  tha  last  several  ysars  In  daallng  with  tha  atudy  of  avionloa  iasuaa  and  eoanand,  oontrol, 
ooanunioationa  ( c3)  Iasuaa,  wa  hava  provad  tha  old  statement  about  complex  problems.  That  la,  for 
avtry  ooaplax  problaa  thara  exists  a  solution  which  la  aiaple,  naat,  and  wrongl 

Undaratanding  and  aaaaaaing  tha  worth  of  ailitary  avionloa  ayataas  and  c3  aystans  have  provad  to  be 
vary  daaanding  tasks  for  both  analysts  and  thoaa  who  aaka  budgatary  daoialona.  The  growing  oonplaxlty 
of  thasa  ayataas  oontinuas  to  inoraasa  this  ohallanga  day  by  day. 

The  really  frustrating  aspeat  of  avionloa  syatsas  and  c3  ayataas  la  that  wa  often  don't  know  how  to 
define  tha  problaa.  Reasoned  and  wsll-aeanlng  people  aiaply  don't  (mow  how  to  raoognlza  military  worth 
in  auoh  ayataas.  With  a  weapon  system  (auoh  as  an  P-15,  Jaguar,  or  Mirage  P-1),  wa  oan  obtain  a  sense 
or  what  It  Is  worth,  for  example,  by  observing  how  wall  it  delivers  ordnanoe  or  duels  with  enemy 
alroraft.  Suoh  la  not  tha  oasa  with  an  avionics  system  or  c3  system. 

If  wa  observe  that  a  c3  system  storaa  a  bit  of  data  or  transaita  a  certain  message,  we  really  can't 
say  auoh  about  ailitary  worth  until  wa  know  a  ooupla  of  additional  things.  Wa  need  to  know  how  tha 
pilot  or  taotioal  decisionmaker  ia  likely  to  use  tha  data  provided  by  the  C3  system.  And  we  need  to 
know  what  difference  this  ia  likely  to  aaka  in  the  ooabat  situation. 

It  ia  to  question*  Ilk*  "how  art  avionloa  ayataas  and  c3  syatsas  used?1',  and  "what  dlfftrenoe  do  they 
aaka?"  that  I  would  Ilka  to  return  In  a  moment.  Por  tha  present,  1st  me  aay  something  about  the  theme 
of  this  38th  teahnloal  meeting, 


Theme  of  the  38th  Teohnloal  Meeting 

Aa  mantionad  In  tha  announcement ,  tha  theme  of  thin  taohnloal  meeting  concerns  simulation  techniques  and 
thalr  applications  to  tha  atudy  Of  avionics  systems  and  c3  systems  associated  with  airborne 
operations.  Now  many  paopla  look  upon  simulation  models  as  a  oolleotion  of  mathematical  statements  and 
oomputer  soienoa  teohniquea  arranged  ao  as  to  provide  quantitative  answara  to  oomplex  problems.  As  any 
modal  developer  oan  tell  you,  the  situation  la  not  quits  that  simple. 

I  tend  to  view  simulation  modeling  In  a  muoh  more  philosophical  sense,  that  is,  aa  a  systematic 
framework  for  analysis.  Simulation  modeling  provides  a  unifying  conceptual  struoturs  for  cisoussing  and 
investigating  a  given  issue.  Simulation  modeling  provides  us  with  a  oommon  abstraction  of  the 
real-world  situation  and  a  oommon  lexicon  of  terms  with  which  to  debate  issues  and  oxohange  ideas. 

Tha  rola  of  aimulation  modeling  ae  a  conceptual  framework  or  oommon  lexicon  takes  on  speoial 
algnifloanoa  for  avionloa  syatema  and  C3  systems.  In  1978,  the  U.S.  Defense  Solanoe  Board  Task  Force 
on  Command  and  Control  Systems  Management  recognized  the  complexity  of  auoh  aystamn,  but  also  noted  that 
the  military  hat  no  oomonly  understood  vocabulary  or  ooncaptual  framework  for  analyzing,  debating,  or 
evaluating  C3  aystams.  Othar  oonferenoea  held  on  this  eubjeot  have  arrived  at  essentially  the  same 
thought,  that  wa  lack  a  oommon  understanding  of  how  avionloa  systems  and  c3  systems  contribute  to 
military  roroa  effaotlveneaa. 

Henoa,  I  viaw  our  meeting  here  thia  week  with  apeolal  interest.  In  holding  a  meeting  on  the  aimulation 
of  avionloa  systems  and  c3  ayotema,  we  are  diaouaslng  mors  than  Just  mathematical  teohniquea  and 
oomputer  languages.  In  aasenoe,  we  are  disouasing  the  framework  within  whioh  eaoh  of  us  views  oommand 
and  oontrol  (or  battle-management)  problems  and  competing  solutions.  We  are  eaoh  presenting  what  wa 
believe  to  be  Important  aapeots  of  oommand  and  oontrol  and  what  determines  ths  contribution  of  oommand 
and  oontrol  to  military  Toros  effectiveness . 

Viewed  in  thia  light,  I'm  aura  wa'li  find  the  next  several  days  both  interesting  snd  informative. 

Now,,  having  oat  tha  philosophical  ataga  for  aimulation  modeling,  let  me  aay  a  few  words  about  our  own 
vt«IW»  within  Air  Foroa  Studies  end  Analyses.  First,  I  will  return  to  the  questions  of  "how  are  avionloa 
aystams  and  c3  systems  used?",  end  "what  difference  do  they  make?"  and  disouss  what  it  is  that  we 
expeot  from  our  own  simulation  modala.  What  ona  sxpeota  from  a  simulation  modal  should  ba  uppermost  in 
avary  model-daveloptr'a  thoughts. 

Second,  I  will  briefly  outline  the  hierarohioal  approach  wa  hava  taken  in  organizing  our  various 
simulation  modala  within  Air  Foroa  Studlaa  and  Analyaas,  This  hierarohioal  tpproaoh  ia  diotated  by  soma 
very  praotloal  considerations.  However,  it  also  turns  out  to  be  a  useful  way  of  establishing  tha  oommon 
oonoaptual  framework  1  mentioned  earlier. 


System  Effloleney  Versus  Military  Worth 


Avionics  systems  and  c3  systoms,  like  any  other  military  system,  must  be  Justified  in  terms  of  their 
contribution  to  foroe  effectiveness.  The  Increasing  cost  of  many  avionlos  systems  and  c3  systems  in 
contrast  to  our  constrained  defense  budgets  has  foroed  us  to  distinguish  between  "nioe-to-have"  and 
"essential"  systems.  But  what  are  we  looking  for? 

In  a  talk  that  I  gave  to  the  Military  Operations  Research  Sooiety  baok  in  1977  >  I  asked  how  one  would 
reoognize  a  perfect  avionlos  system  or  c3  system.  The  orlterla  stated  then  (which  I  still  believe 
holds  true)  were  as  follows.' 

Preserving  the  order  and  oohealveness  of  your  own  foroea.  against  the  foroes  of  ohaoe,  is  the  first 
criterion,  Cohesiveness  is  the  prerequisite  to  survival  and  to  all  other  activities.  The  natural 
tendenoy  of  any  combat  force  is  to  diffuse  into  uncoordinated  inaotlon. 

S.L.A.  Marshall,  a  noted  military  historian,  writes  in  his  book,  "Men  Against  Fire",  about  the  problem 
of  maintaining  oohesion  among  advancing  Infantry  troops  during  the  Faolfio  fighting  of  World  War  II. 
Whenever  the  advancing  infantry  line  oaae  under  fire,  a  resulting  delay  of  45  to  £0  minutes  ooourred 
before  the  advanoe  could  be  reorganized. 

As  it  turned  out,  the  delay  was  caused  by  the  men  seeking  ground  cover  and  losing  eyesight  of  one 
another.  While  erect,  these  men  had  eye  oontaat  with  their  flanks  ...  a  situation  whioh  allowed  them  to 
sense  the  unity  and  movement  of  their  squad.  Dropping  to  the  ground,  the  men  unexpectedly  lost  this 
sense  of  unity  and  awareness  and  oould  only  slowly  regain  it  by  restoring  interpersonal  oontaot. 

More  reaently,  the  Israelis  in  the  1973  war  cited  the  looation  of  their  own  troops  as  the  most  serious 
problem  in  target  acquisition,  command  and  control,  and  reoonnaiaaanoe. 

Avoiding  blunders  and  insuring  freedom  of  action  is  the  seoond  criterion,  If  one  la  to  prevent 
situations  from  whioh  thara  Is  no  subsequsnt  reoovery.  Blunder  muat  be  avoided  in  order  to  maintain  the 
ability  to  fight  at  the  time  and  plaos  of  the  oommander'i  ohooslng. 

In  the  Amerloan  Civil  War,  the  Battle  of  Chlckamauga  provides  us  with  an  Illustration  of  this  point.  An 
order  for  a  Union  division  to  advanoe  into  the  front  line  was  lost  during  its  transmittal.  Instead,  the 
Union  division  waited  in  reserve,  Unfortunately  for  the  Union  side,  that  gap  in  the  front  line  turned 
out  to  be  dlreotly  on  the  main  axis  of  the  Confederate  sttsok.  The  Union  army  did  not  graowfully 
reoover  from  this  blunder. 

During  World  War  II,  Lieutenant  General  Bayerleln,  command  of  Panzer  Lehr  Division,  mistakenly 
interpreted  a  favorable  situation  at  tha  Battle  of  Baabogne.  Hearing  heavy  firs  on  his  left  flank  near 
the  village  or  Wardln,  he  assumed  that  the  fire  was  coming  from  Amerloan  ioroaa  Just  entering  the 
village,  In  actuality,  the  fire  was  oomlng  from  his  own  reoonnaisaanos  battalion  whioh  had  nearly 
destroyed  and  soattered  on  Amerloan  oompany  in  the  village.  His  erroneous  conclusion,  based  on  aketohy 
information,  oaused  him  to  prepare  his  foroes  for  withdrawal  and  to  recommend  a  suspension  or  the  sttsok 
on  Baatogne  ...  Just  at  the  time  when  conditions  were  favorable  to  the  aerman  foroes. 

The  third  criterion  is  Insuring  non-zero  effectiveness  of  your  own  oombet  forots.  A  non-zero 
effectiveness  is  essential  to  winning,  as  opposed  to  the  first  two  orlterla,  whioh  jre  prerequisites  for 
avoiding  defeat. 

Wa  can  illustrate  this  criterion  with  a  Nipoleonlo  example.  He  endeavored  in  all  oaaea  to  find  a 
favorable  place  end  time  for  battle.  He  made  a  massive  commitment  with  little  subsequent  effort  to 
fine-tune  or  optimize  the  attack.  He  won  most  of  the  time. 

Returning  to  S.L.A.  Marshall,  he  found  that  even  in  the  most  herolo  of  lnstsnoss,  no  more  than  a  small 
fraotion  of  the  engaged  Infantrymen  fired  their  weapons  ...  typloally  on  the  order  of  20  -  25  peroent. 
This  astounding  figure  points  out  that  even  with  extensive  training  and  combat  experience,  the  major 
problem  for  an  Infantry  oommandor  is  to  get  his  men  to  take  an  active  part  in  the  battle. 

Optimization,  or  insuring  efficiency,  of  force  effectiveness  ranks  no  higher  than  4th  place.  Probably, 
it  ranks  olosar  to  17th  p.l«oe  in  the  list  of  c3  system  criteria.  In  s  sense,  this  relative  uraphasie 
is  unfortunate  for  those  of  us  engaged  in  olasaioal  operations  research  and  systems  analysis.  In  these 
fields,  we  have  beaome  used  to  thinking  in  terms  of  optimization,  effioienoy,  and  marginal  return.  That 
is,  we  axpeot  to  deal  with  functions  whioh  behave  in  a  smooth,  continuous  manner.  These  terms,  however, 
are  somewhat  Inappropriate  when  dealing  with  uncertainty,  two-sided  force  capabilities,  enemy 
Intentions,  Jamming,  deception,  and  so  forth.  Real  battles,  it  turns  out,  are  rarely  oonduoted 
aooordlng  to  narrowly  constrained  rules  or  won  by  small  margins. 

Instead  of  produolng  a  nice,  smooth  marginal  increase  in  foroe  effectiveness ,  the  addition  of  a  new 
avionlos  system  or  c3  system  may  result  in  a  quantum  Jump  from  zero  foroe  effectiveness  ...  the  result 
of  avoiding  a  blunder  or  maintaining  foroe  ooheaion  at  a  critioal  instance.  On  the  other  hand,  the 
addition  of  a  new  avionlos  system  or  c3  system  may  not  guarantee  any  fo^oe  effectiveness  improvement 
at  all.  The  reason  for  this  la  because  many  command  and  oontrol  Issues  Involve  situational  and 
oonoeptual,  as  well  aa  technical,  aspects,  That  Is,  the  contribution  of  an  avionics  system  or  c3 
system  depends  upon  three  ingredients: 

System  uerformanoi  -  What  can  the  avionlos  system  or  c3  system  provide  In  terms  of 
oombot  Information,  message  transmittal  rates,  and  so  forth? 

Exploitation  opportunities  -  (liven  the  two-sided  nature  of  combat,  what 
opportunities  exist  for  the  taotioal  decisionmaker  to  Influence  events  or  avoid 
mistakes? 


neaiainn  performance  -  can  tht  taotioal  daoisionmnlter  utilise  tha  avlonios  system  or 
C3  systaa  to  assist  in  reoognizing ,  exploiting,  and  creating  auoh  opportunities? 

While  performance  it  of  dlreot  Interest  to  the  system  developer,  tha  other  two  ingredients  play  an 
essential  role  in  determining  military  worth.  The  second  ingredient  (exploitation  opportunities) 
relates  to  the  earlier  question  of  "what  difference  does  it  make?" ,  while  thj  third  ingredient  (deolslon 
performance)  relates  to  "how  is  the  system  used?". 

Put  another  way,  an  avlonios  system  or  c3  system  deals  in  information.  And  information  la  information 
only  if  it  (1)  resolves  a  real  ambiguity  and  (2)  something  oan  be  done  about  it. 

So  here  I  have  identified  the  three  key  questions  to  ack  in  the  analysis  of  avionics  systems  and  C3 
systems! 


What  oan  the  system  provide? 

Where  oan  the  system  make  a  difference? 

How  must  the  system  be  used  to  make  that  difference? 

1  should  mention  at  this  point  that  these  questions  oan  be  asked  at  any  system  or  organisational  level. 
They  apply  equally  to  an  avlonios  subsystem  for  a  fighter  aircraft  as  well  as  to  a  theater-level  air 
defense  oontrol  system,  The  point  here  is  that  ws  simply  must  try  to  get  the  bast  military  worth  return 
fur  our  defense  expenditures  ...  throughout  the  entire  speotruu  of  avlonios  systems  and  C3  systams.  A 
proposed  system  whioh  doesn't  meet  the  test  of  the  "what",  "wh*"e",  and  "how"  questions  is  not 
affordable  in  these  days  of  constrained  defense  budgets. 

Now  it  turns  out  that  answering  these  questions  in  any  meanlngfu.,  rt  of  way  oan  bo  a  rather  dlffioult 
Job.  In  justifying  the  acquisition  of  a  new  avlonios  system  or  C3  /stem,  the  analyst  ia  attempting 
to  build  a  story  which  relates  the  cspsbilitlea  of  the  new  syatsm  to  some  Improvement  In  foroe 
effectiveness.  Hence,  we  turn  to  simulation  models  whioh  involve  sons  portrayal  of  oombat  operations. 
But,  then  one  asks  "foroe  effectiveness  st  what  level  of  combat?"  One-on-one?  Many-on-many?  Single 
mission?  Total  foroe? 

The  lnterdspendanoy  of  weapon  systems,  avlonios  systems,  end  c3  systems,  pins  the  need  to  make 
meaningful  system  trade-offs,  lead  the  analyst  to  seek  answers  st  higher  and  more  enoompaasing  levels  of 
oombat  operations.  Correspondingly,  the  analytloal  tools  employed  for  these  analysis  have  grown  in  both 
scope  and  detail.  I  have  eeen  thia  type  of  growth  in  our  own  oombat  simulation  modala  as  more  foroe 
components  and  mission  areas  srs  sddsd  to  increase  the  robuatnees  of  the  particular  methodologies. 

Unfortunately,  we  eventually  reach  a  practical  limit  on  the  size  of  our  simulation  programs  due 

either  to  the  storage  oapaclty  of  our  digital  oomputsrs  or  to  the  time  it  takas  to  extract  meaningful 
results. 

To  illustrate,  aaaumu  for  the  moment  that  we  have  oonstruotad  a  large  (say,  theater-level)  simulation 
program  capable  of  refieoting  a  moderate  amount  of  detail  about  a  two-sided  oonfllot  situation.  Further 
assume  that  this  simulation  progrsm  saoepts  on  the  order  of  100  input  parameters. 

Now,  being  prudent  analysts,  we  wish  to  understand  tha  sensitivity  of  this  model  to  ohangss  in  these 
various  input  parameters,  With  a  minimum  of  two  vsluss  for  aaoh  input  parameter,  we  would  require 
2100  or  about  1030  runs  of  tha  simulation  progrsm.  Consider  further  that  our  simulation  model  is 

vary  fast  ...  on  the  order  or  nanoseoonde,  with  a  processing  time  of  10“®  aeoonda.  Evan  with  a  fast 

model,  it  would  take  us  10Z1  aeoonda,  or  about  1011  centuries  to  complete  our  simple  sensitivity 
analysis. 

Ths  point  of  this  overly  simplified  illustration  is  that  large  simulation  models  are  not  always  very 
nrsotioal  to  build  and  employ.  One  runs  the  danger  of  spending  too  muoh  time  attempting  to  understand 
the  behavior  of  the  model  ...  with  little  confidence  that  its  important  features  have  been  verified. 
Additionally,  large  simulation  models  force  the  analyst  to  aoospt  the  results  on  a  take-it-or-lssve-lt 
basis.  Little  opportunity  is  provided  for  the  analyst  to  step-wise  build  up  oonfidenoe  with 
intermediate  results, 

Within  Air  Foroe  Studies  and  Analyses,  ws  hive  ohosen  to  dssl  with  this  situation  by  organizing  our 
simulation  models  in  hierarchical  fashion.  The  advantage  of  hlerarohioal  models  is  assy  to  sse  from  oy 
original  example.  Suppose  we  ire  able  to  take  our  original  simulation  program  and  brisk  it  down  into  a 
hlerarohioal  set  of  10  models,  eaoh  aooounting  for  10  of  the  original  100  input  parameters. 

Now,  for  eaoh  new  model  we  hive  210  •  1024  rune  of  the  program  to  complete  its  sensitivity  testing. 

For  the  set  of  10  models,  ws  have  10  x  2 1 0  „  io,24o  runs  ...  quite  a  gain  in  sffiolsnoy  over  the 

1030  runs  required  with  our  single  model.  With  a  hiersrohy  of  20  modala,  eaoh  aooounting  for  5  of  the 

original  input  parameter's,  the  gain  ia  even  greater  with  only  640  run!  required. 

To  illustrate  one  suoh  hierarchy,  oonaider  air  defense  operations  for  a  moment.  At  the  bottom  level  of 
thia  hiersrohy,  we  employ  simulation  modala  whioh  address  one-on-one  oombat  engagements.  for 
fighter-veraus-flghter  engagements,  we  have  a  modol  whioh  simulates  one-on-one  duels  using  a  standard 
repertoire  of  aerial  baotioa  for  eaoh  alroraft.  A  datailad  poat-prooeoaor  computes  the  expected  results 
of  gun  firings  or  missile  launohes  for  eaoh  firing  opportunity. 

For  surface-to-air  defenses,  we  have  a  family  of  one-on-ons  attrition  models.  These  models  simulate  the 
detailed  kinetlo#  of  single  missile  launohes  and  gun  firings.  Example  effects  portrayed  at  this  level 
of  simulation  Include  the  impact  of  countermeasures,  imperfect  tracking  information,  and  aircraft  speed, 
altitude,  and  maneuver. 


Moving  up  the  hlararohy,  we  enploy  more  aggregated  models  to  integrate  several  weapon  systems 
simultaneously.  For  fighter- versus -fighter  operations,  we  are  developing  •  simulation  model  for 
few-on-few  engagements.  This  model  addressee  the  coordination  of  taotios  which  ooours  among  different 
aircraft  in  the  same  flight  unit. 

For  aurfhoe  defenses,  we  have  another  model  which  simulates  an  array  of  defenae  units.  Issues  addressed 
by  this  simulation  model  begin  to  take  on  a  more  complex  nature  involving  threat  prioritisation,  fire 
distribution,  defense  suppression,  and  so  forth. 

At  the  next  level  in  the  air  defense  hlerarohy,  we  are  developing  a  model  which  addresses  integrated 
ground  defenses  and  fighter  operations.  Here  we  are  developing  the  modal  as  a  top-down  nodular 
structure  of  event-processors.  The  simulation  includes  detailed  ooanand  and  oontrol  logic  for 
integrating  a  variety  of  related  missions  and  activities  under  a  stressed  environment. 

At  the  highest  level,  we  examine  theater-level  operations  using  a  acre  aggregated  modeling  approach. 
Here,  offensive  and  defensive  air  operations  are  portrayed  in  an  attempt  to  gain  a  sense  of  the  entire 

theater  air  war.  However,  some  detail  is  lost  as  the  simulation  la  based  on  the  use  of  Markov  state 

transition  processes, 

As  I  mentioned  before,  we  turned  to  the  hierarchical  approaoh  for  basically  practioal  reasons  ...  that 
is,  not  wanting  to  spend  1011  oenturles  waiting  for  answers,  As  we  developed  our  model  hierarchies, 
however,  we  began  to  discover  that  they  provided  a  useful  way  of  organising  our  thinking  about  problems. 

Now,  looking  through  the  planned  agenda  for  this  week,  I  notloed  that  the  various  papers  correspond  in  a 

sense  to  a  similar  type  of  hierarchy,  we  start  off  with  theater-level  system  simulation  and  gradually 
work  our  way  down  to  subsystem  simulation, 

Acoordingly,  I  thought  it  might  be  appropriate  to  spend  the  remainder  of  this  time  discussing  a  few  or 
the  lessons  we've  learned  with  using  hierarchical  models.  These  observations  might  be  particularly 
useful  later  this  week  as  we  listen  to  the  various  perspectives  on  avlonioa  systems  and  c3  systems  and 
attempt  to  oonatruot  a  oomnon  framework  for  analysis, 


Simulation  Models  -  Hlerarohy  and  Consistency 

Nr  aside  from  the  practical  reasons  for  wanting  hierarchical  models,  we've  found  several  other 
advantages.  First,  we've  found  that  this  approaoh  provides  a  natural  framework  for  organising 
integrated  study  teams  within  Air  Foroa  Studies  and  Analyses.  Focusing  on  a  particular  echelon  or 
mission  area  allows  us  the  opportunity  to  effectively  oombine  analytical  and  operational  talent  into  a 
cohesive  study  group.  This  group  becomes  our  critioal  mass  for  innovative  analysis. 

For  command  and  control  problems,  this  approach  is  critical  to  achieving  a  well-developed  understanding 
or  the  "what",  "where",  and  "how"  questions  posed  earlier.  Answers  to  these  questions  require  a  lot  of 
good,  imaginative  thinking  about  the  requirements  of  oombat  and  the  potential  for  improving  force 
effectiveness.  We've  found  that  foouslng  small  Integrated  groups  on  speolflo  aspects  of  a  command  and 
oontrol  problem  suooaeds  best.  For  example,  Air  Foroe  Studies  and  Analyses  has  one  study  team  devoted 
to  defense  suppression,  another  to  offensive  air  support,  and  yet  another  to  higher  eohelon  c3  issues. 

A  seoond  advantage  of  hieraohlcal  models  is  that  we  are  able  to  provide  short-term  answers  to  command 
and  control  problems  while  waiting  for  more  oomplex  models  to  be  built.  One-on-one  or  fsw-on-few 
situations  may  be  examined  in  detail  by  lower  level  models  in  the  hlerarohy.  Thus,  we  are  able  to 
step-wise  build  up  confidence  In  these  models  before  Integrating  their  results  Into  more  oomplex 
analyses. 

Both  of  these  advantages  are  Just  reflections  of  good  analytical  approaoh.  That  Is,  we  must  address  any 
oomplex  problem  like  oommand  and  control  by  breaking  it  down  into  understandable  components.  The  notion 
of  a  hlerarohy  of  models  is  naturally  aonaistant  with  this  procedure. 

For  example,  In  relating  c3  capabilities  to  an  improvement  in  foroe  effectiveness,  one  might  address  a 
hlerarohy  of  effectiveness  measures.  At  the  bottom  of  the  hlerarohy,  we  might  be  Interested  In 
"single-engagement  probability-of-kill" .  Moving  upward  in  the  hierarchy,  one  might  address 

"single-mission  effectiveness"  or  "single-raid  effectiveness" .  Eventually,  one  oould  relate  C3 
capabilities  to  improvements  in  theater-level  effeotiveness  by  addressing  "5-day  air  oampalgn  results". 

A  hierarchy  or  this  type  allows  one  not  only  to  relate  military  objectives  to  one  another,  but  also  to 
construct  an  explioit  accounting  of  how  avionlos  or  c3  systems  contribute  to  fulfilling  these 
objectives.  Moving  upward  In  the  hierarchy  of  effeotiveness  measures,  one  oan  ask  "why  is  it  important 
to  achieve  a  lower-level  military  objective?"  Moving  downward  in  the  hlerarohy  allows  one  to  ask  "what 
detailed  objectives  must  be  met  in  order  to  achieve  this  overall  measure  of  foroe  effectiveness?" 

Similarly  for  avionics  systems  and  c3  systems,  one  may  ask  "why  is  it  Important  that  a  speolflo  data 
rate  or  type  of  information  be  provided  at  a  given  oommand  echelon?"  Or,  oonveraely,  "that 
lower-echelon  oommand  and  oontrol  capability  must  be  provided  and  integrated  to  permit  the  successful 
completion  of  some  overall  plan  or  operation?" 

Thus,  we  have  found  that  hierarchical  models  provide  us  with  a  structured  approaoh  to  analysis.  By 
proceeding  one  step  at  a  time,  we  are  able  to  relate  avionlos  system  and  C3  system  capabilities  to 
foroe  effeotiveness  in  a  logioal  manner. 


Now  I  must  point  out  that  there  is  still  a  substantial  degree  of  "art"  associated  with  deciding  where 
and  how  to  break  down  a  problem  Into  e  set  of  hlerarohiotl  models.  Many  problems  oan  arise  end  most  or 
these  problems  have  something  to  do  with  Insuring  ooneistenoy  among  model  results. 
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The  nature  of  this  problem  is  easy  to  see  from  my  example  discussed  earlier.  Recalling  our  original 
simulation  model  with  100  input  parameters,  I  noted  that  about  103°  runs  are  needed  to  perform  a  full 
sensitivity  analysis.  With  10  models,  about  10,640  runs  are  required.  With  20  models,  only  about  640 

runs  are  needed. 

This  gain  in  effioienoy  does  not  oome  free,  however.  By  breaking  down  our  one  large  simulation  model 
into  several  smaller  models,  we  have  lost  the  capability  to  explicitly  represent  the  interactions 
occurring  between  each  subset  of  input  parameters.  Now,  if  we  had  the  ideal  situation,  we  might  be  able 
to  seleot  subsets  whioh  were  nearly  independent  of  one  another.  Thus,  we  could  run  each  of  our 
hierarohioal  models  and  not  worry  .too  much  about  their  results  being  incongruous  or  incompatible. 

Unfortunately,  we  oan  not  always  insure  that  our  different  models  are  independent  of  one  another. 
Often,  we  find  rather  strong  interdependencies  existing  among  different  models  in  a  hierarchy.  Hence, 
we  must  worry  about  consistency! 

There  are  two  basic  criteria  associated  with  consistency.  First,  we  must  insure  that  model  parameters 
essentially  mean  the  same  things  in  different  simulation  models.  That  is,  the  definition  and 
surrounding  assumptions  for  parameters  output  from  one  model  must  be  consistent  with  the  manner  in  which 
they  are  used  as  input  to  another  model.  Secondly,  the  behavior  of  model  parameters  must  be  consistent. 
That  is,  we  must  insure  parameter  continuity  in  a  calculus  sense  ...  a  consistency  among  derivatives  of 
the  1st  order,  2nd  order,  and  so  forth. 

To  insure  that  both  criteria  are  met  as  well  as  possible,  we  have  found  it  desirable  to  overlap 
simulation  models.  That  is,  we  purposely  duplicate  certain  operations  and  detail  in  two  or  more  models. 
This  allows  us  the  opportunity  to  check  first-hand  on  whether  or  not  parameter  definitions  and  behavior 
are  being  contradicted. 

Returning  to  the  analysis  of  avionics  systems  and  c3  systems,  we  have  found  the  concern  for  model 
consistency  to  be  particularly  great.  Here,  we  must  Insure  consistency  for  each  of  the  "what",  "where", 
and  "how"  questions  posed  during  the  analysis. 

Problems  of  consistency  involve  the  technical  performance  of  a  given  avionics  system  or  03  system,  the 
tactics  and  procedures  by  which  the  systems  are  employed,  and  the  likely  environment  in  which  they  are 
expected  to  contribute  to  force  effectiveness .  Assumptions  which  seem  reasonable  at  one  level  of 
analysis  must  be  enforceable  at  another.  For  example,  if  we  assume  a  certain  message  loading  rate  while 
analyzing  the  detailed  performance  of  a  communications  system,  we  need  to  insure  that  thi3  message 
loading  rate  is  representative  of  the  total  number  of  users  involved. 

Insuring  consistency  can  become  particularly  troublesome  when  several  different  missions  are  combined 
into  a  higher  level  analysis.  In  examining  the  details  of  one  mission  area  (say,  offensive  air  support) 
there  is  a  tendency  to  Ignore  critical  conditions  which  must  be  met  for  other  mission  areas  (such  as  air 
defense).  Airspace  management  and  the  competing  requirements  for  air  defense  and  safe  passage  of 
friendly  offensive  aircraft  are  good  examples  of  this  type  of  concern. 

Now  I've  been  concerned  with  this  problem  for  some  time.  Within  Air  Force  Studies  and  Analyses,  we 
conduct  seminars  where  our  analysts  get  together  in  an  attempt  to  achieve  some  degree  of  model 
consistency  and  configuration  control.  I  even  have  a  special  staff  office  charged  with  the 
responsibility  of  thinking  about  this  general  problem. 

With  our  increasing  interest  in  avionics  and  c3  issues,  we've  found  that  model  consistency  requires 
even  more  attention.  The  subtle  synergism  existing  among  technical  performance,  the  combat  environment, 
and  how  the  systems  are  used  provides  a  lot  of  opportunity  for  model  divergence,  if  not  properly 
monitored.  Indeed,  the  U.S.  Defense  Science  Board's  comment  on  the  lack  of  a  commonly  understood 
vocabulary  or  conceptual  framework  says  a  lot  about  the  magnitude  of  this  problem. 

Hence,  the  charge  I  would  like  to  leave  you  with  this  week  is  one  of  insuring  consistency  ... 
consistency  of  models  and  consistency  of  analyses.  We  must  insure  that  our  detailed  analyses  of 
avionics  systems  and  c3  systems  are  logical  extensions  of  our  more  aggregated  studies.  We  must  focus 
on  our  own  particular  subsystems  and  issues,  but  we  must  also  maintain  a  general  awareness  of  the 
overall  environment  in  which  these  subsystems  operate.  We  must  begin  to  build  the  common  vocabulary  and 
conceptual  framework  for  avionics  and  c3  analysis.  And,  above  all,  we  must  provide  our  forces  with 
avionics  systems  and  c3  systems  attuned  to  real-world  needs. 
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SUMMARY 

This  paper  contains  an  Introduction  to  the  aalaction  and  use  of  simulation  languages  for  digital  computers. 
Tha  topics  discussed  are  the  hierarchy  of  computer  languages  and  thalr  relationship  to  simulation,  the 
advantages  and  disadvantages  of  using  simulation  languagas,  the  factors  to  consider  in  selecting  simula¬ 
tion  languages  for  an  organisation  and  a  language  for  solving  a  specific  problem,  soma  characteristics  of 
tha  simulation  languagas  GASP,  GPSS,  SIMSCRIPT,  SIMULA,  and  SLAM,  and  futura  developments  in  simulation 
languagas.  The  emphasia  is  on  discrata  and  combined  simulation  languagas. 

1.  INTRODUCTION 

One  of  the  time  consuming  steps  in  a  simulation  study  is  tha  translation  of  the  defined  flowchart  modal 
into  a  computer  program  to  bs  run  on  a  digital  computer.  There  are  several  different  types  of  computer 
languagas  that  can  be  used,  each  with  their  own  strengths  and  weaknesses.  The  purpose  of  this  paper  is 
to  provide  an  introduction  into  selecting  and  using  a  language  for  performing  this  step  in  a  simulation 
study.  The  language  should  ba  salacted  prior  to  developing  Che  flowchart  modal  because  there  must  ba  a 
compatibility  betvasn  how  tha  system  is  modelled  and  tha  computer  languaga  used.  More  thorough  general 
treatments  of  simulation  languages  and  thalr  uaa  can  be  found  in  Emahoff  et  al,  1970,  Fishman,  1978, 

Gordon,  1977,  Korn  st  al.,  1978,  Pritsker  et  al.,  1979,  and  Shannon,  1975. 

2.  HIERARCHY  UP  COMPUTER  LANGUAGES 

The  digital  computer  oparatas  in  a  language  called  machine  language  which  consists  of  O' a  and  l's.  We 
do  not  program  in  this  languaga  due  to  its  complexity.  The  next  level  of  computer  languages  is  assembly 
languagas  and  they  are  usually  machine  dependant.  Programs  are  written  in  assembly  language  only  if  they 
are  to  bs  used  over  and  over  again  because  the  programing  effort  required  ia  considerable.  Analysts  al¬ 
most  never  used  assembly  language  to  program  simulation  models. 

The  next  level  of  computer  languages  is  general  purpose  or  higher  lavel  languagas.  They  are  user  oriented 
and  are  usually  machine  independent.  Machine  independent  means  that  if  an  application  program  is  written 
in  ons  of  these  languages,  that  program  will  generally  run  on  any  computer  having  that  language.  General 
purpose  languages  ara  either  compiler  or  interpreter  languages.  A  compiler  language  uses  a  compiler  to 
convert  application  programs  into  machine  language  or  into  assembly  language  for  conversion  to  machine 
language.  This  compiling  {conversion)  takes  a  certain  amount  of  computer  time.  Tha  computer  than  "executes" 
the  resulting  machine  program. 

In  interpreter  languages,  each  line  of  the  application  program  is  converted  to  machine  languaga  each  tlms 
it  is  executed.  This  means  that  if  a  line  of  an  application  program  is  used  several  times,  it  must  be 
converted  to  machine  languaga  each  time.  Interpretive  languagas  generally  require  more  computer  time  for 
discrete  event  simulation  than  compiler  languagas  because  a  considerable  portion  of  discrete  event  simu¬ 
lation  programs  are  used  over  and  over  again. 

General  purpose  languages  are  frequently  used  in  programming  simulation  models  and  is  tha  implementation 
language  of  several  simulation  languages.  FORTRAN  is  the  general  purpose  language  most  used  for  simula¬ 
tion  in  the  United  States  and  ia  alao  the  implementation  language  of  the  GASP  and  SLAM  simulation  languages. 
Examples  of  these  languages  are  given  in  Table  1. 

The  next  level  of  computer  languages  are  problem  or  application  oriented  in  addition  to  being  user  oriented. 
Simulation  languages  belong  to  this  level  of  languages.  Beginning  in  tha  lata  195C's  and  earlier  1960's, 
different  groups  of  Individuals  performing  simulations  recognised  that  savaral  of  the  same  functions  were 
used  in  almost  every  simulation  and  they  therefore  could  be  programmed  into  subroutines  and  "tiad"  together 
to  be  used  for  futura  simulations.  From  these  special  programs  (languages,  if  you  wish),  simulation  lan¬ 
guages  have  evolved  until  today  we  have  commercially  available  several  general  and  special  purpose  simula¬ 
tion  languages,  Including  soma  extremely  sophisticated  ones.  Several  examples  are  given  in  Table  1. 

General  purpose  simulation  languages  can  ba  broken  into  three  general  classes i  discrata,  continuoua,  and 
combined  (discrete/continuous).  Discrete  simulation  languagas  are  for  programming  discrata  event  simula¬ 
tion  models,  i.e.,  simulation  models  whose  "states"  (variables)  change  at  specific  points  in  time.  Con¬ 
tinuous  simulation  languages  are  for  models  whose  variables  (states)  change  continuously  over  time.  Com¬ 
bined  languages  ere  of  recant  development  and  provide  the  capability  of  allowing  models  to  have  variables 
that  may  change  discretely,  continuously,  and  continuous  with  discrete  jumps. 

Special  purpose  simulation  languagas  ara  simulation  languages  that  have  been  developed  for  modelling  and 
simulating  specific  types  of  systems.  Spscialissd  simulation  languagas  for  simulating  computer  systems 
are  examples  of  these  languagas.  Many  of  the  special  purpose  simulation  languages  have  evolved  from 
general  purpose  simulation  languagas.  Some  examples  are  contained  in  Table  1.  Both  general  purpose  and 
special  purpose  simulation  languages  are  widely  used. 

The  remainder  of  this  paper,  unless  otherwise  stated,  will  ba  restricted  to  discrete  and  combined  simula¬ 
tion. 


This  paper  is  based  on  "Introduction  to  Simulation  Languages,"  by  Sargent,  Robert  G.,  contained  in  the 
Proceedings  of  the  1978  Winter  Simulation  Conference . 


TABLE  1 


HIERARCHY  OF  COMPUTER  LANGUAGES  WITH  EXAMPLES 


Machine  Languages 

Assembly  Languages 
BAL,  MACRO  10 

General  Purpose  Languages 
Compiler j 

ALGOL,  BASIC,  COBOL,  FORTRAN,  PL/1 

Interpreter l 
APL,  LISP 

Simulation  Languages 
Gansral  Purpose 
Dissretat 

EC3L,  GASP,  GPSS,  MILTRAN,  SIMSCRIPT,  SIMPL/1,  SIMULA,  SLAM 
Continuous! 

CSMP,  DARE,  DYNAMO,  MIDAS,  MIMIC 
Combined!  (Discrete/Continuous) 

C-SIMSCRIPT,  GASP  IV,  SLAM 

Special  Purpose! 

CSS  II,  ECSS  II,  Q-GERT 


3.  WHY  SIMULATION  LANGUAGES 

The  major  advantage  of  uelng  simulation  languages  ovar  othar  languagss  Is  the  reduction  In  programming  time 
required  to  program  the  modal.  This  Is  extremely  Important  as  it  allows  the  analyst  performing  the  simu¬ 
lation  study  to  devote  more  time  to  other  phases  of  the  study.  In  addition,  most  simulation  languages  pro¬ 
vide  conceptual  guidance,  modelling  capability,  and  eld  In  communication  and  documentation. 

The  dlesdvantagee  of  uelng  simulation  languages  era  (1)  the  coat  of  obtaining  and  maintaining  than,  (11) 
tha  tlma  analysts  muat  spand  laaming  the  simulation  languages  thay  plan  to  uta,  and  (Hi)  the  increased 
computer  atoraga  and  computations  time  required  in  uaing  them  beyond  what  la  needed  in  using  a  general 
purpoae  language. 

Simulation  languagae  generally  provide  at  least  the  following! 

(a)  World  View 

(b)  Time  Flow  Mechanism  (Advance  time  and  keep  a  list  of  future  avanta) 

(c)  Random  Number  Generator 

(d)  Random  Variate  Ceneratore 

(а)  Model  Data  Collection  Capabilities 

(f)  Perform  Elementary  Statistical  Analysis  on  Collected  Date 

(g)  Provide  Error  Diagnostics 

4.  SELECTION  OF  A  LANCUAGE 

There  are  two  different  levels  In  selecting  languages  for  simulation.  The  flrat  level  la  concerned  with 
what  languages  should  ba  available  for  simulation  in  a  given  organiaation.  Tha  second  level  la  what 
language  should  an  analyst  uas  In  a  specific  simulation  study. 

Soma  of  the  factors  that  need  to  be  considered  in  selecting  languages  for  an  organisation  arai 

(1)  Language  compatibility  with  organisation' e  computer  system) 

(2)  Language  edaquataly  supported) 

(3)  Language  aultabla  for  problems  that  likely  will  be  simulated) 

(4)  What  are  the  coats  to  obtain,  Install,  maintain,  and  update  tha  language; 

(5)  Effort  raquirad  to  laarn  tha  language) 

(б)  Documentation  on  language; 

(7)  Eaaa  of  uaing  language) 

(8)  Language  computer  tlma  efficiency; 

(9)  Language  storage  requirements) 

(10)  Language  flexibility) 

(11)  Language  capability,  including  error  diagnostics,  modelling  capability,  data  analysis,  etc.) 

(12)  Will  use  of  the  language  justify  its  coat. 

In  selecting  a  language  for  a  specific  problem  the  analyst  generally  considers  at  least  tha  following! 

(1)  What  la  available,  either  inhousa  or  commercially  available  elsewhere  such  as  on  time  sharing  systems. 

(2)  What  languages  does  tha  analyst  know. 

(3)  What  typa  of  problem  does  tha  analyst  have. 

(4)  What  ara  tha  language  capabilities  including! 

(a)  which  world  view:  event,  activity,  or  process; 

(b)  problem  compatibility) 

(c)  data  collection  and  data  analyala) 


(d)  ability  to  axpand  model,  it  necessary ; 

(e)  generation  at  random  numbers  and  varlatea ; 

(f)  error  diagnostics  and  documentation; 

(g)  communication  ability,  particular  to  user  of  model's  results; 

(h)  code  self  documentation; 

(i)  report  capabilities. 

(5)  Programming  effort  required 

(6)  Computer  time  required. 

(7)  Computer  storage  raquired. 

(B)  Portability  of  model,  if  required. 

The  analyst  is  generally  able  to  quickly  reduce  the  choice  of  a  languega  down  to  at  most  one  apacial  purpose 
simulation  language,  one  or  two  general  purpose  simulation  languages,  and  one  or  two  general  purpose  lan¬ 
guages.  The  analyat  than  will  usually  choose  the  language  requiring  the  least  programing  effort  provided 
it  will  allow  flexibility  to  axpand  the  model  in  tha  future,  if  it  should  ever  need  it,  end  the  computer 
and  storage  time  required  to  use  that  language  ia  reasonable. 

In  aelecting  simulation  languages  for  an  organisation  or  a  language  for  a  specific  problem,  one  should  know 
that  thoae  languages  that  requlra  a  longar  learning  time  generally  have  greater  capability  than  those  re¬ 
quiring  a  shorter  learning  time.  One  should  also  be  aware  that  the  simulation  languages  having  the  event 
world  view  usually  require  a  larger  programming  effort  than  thoae  having  tha  process  world  view.  However, 
they  generally  allow  more  control  and  flexibility  in  modelling  and  in  model  data  collection  than  tha  other 
world  views. 

S.  SOME  SPECIFIC  SIMULATION  LANGUAGES 

There  are  numerous  general  end  special  purpose  simulation  languages  available  today.  For  a  variety  of 
reasons,  most  have  not  become  popular.  As  an  example,  Oren,  1977,  list  eighteen  combined  simulation 
languages  but  only  one  of  these  eighteen  have  aver  been  widely  used. 

The  most  popular  dlscrate  general  purpose  simulation  languages  today  are  GASP,  GPSS,  SIMSCRIPT,  and  SIMULA. 
These  languages  ware  born  in  the  early  1960 'a  and  they  continue  to  evolve.  Each  have  their  own  strengths 
and  weaknesses.  Table  2  contains  soma  of  the  characteristics  of  the  current  versions  of  these  languages 
and  on  tha  new  ganaral  purpose  simulation  language  SLAM.  SLAM  has  been  included  because  this  author  be¬ 
lieves  this  language  will  become  popular  in  the  future  because  it  contains  several  different  diacreta  world 
views  in  addition  to  having  continuous  and  combinad  (diecrsts/contlnuous)  modelling  capability.  References 
on  each  of  these  languages  can  ba  found  ir  the  Bibliography  by  using  Table  2. 


TABLE  2 

CHARACTERISTICS  OF  SOME  SIMULATION  LANGUAGES 


Characteristic 


Language  Name 

GASP 

GPSS 

SIMSCRIPT 

SIMULA 

SLAM 

Meaning  of  Name 

General  Activity 
Simulation  Pro¬ 
gram 

General  Purpose 
Simulation  Sys¬ 
tem 

No  specific 
meaning 

No  specific 
meaning 

Simulation  Lan- 
guaga  for  Altar- 
native  Modelling 

Currant  Versions 

GASP  II  (Dia¬ 
creta),  GASP  IV 
and  0ASP._PL/1 
(Diicrete,  Con¬ 
tinuous,  end 
Combined) 

GPSS/360.GPSS  V, 
GPSS/H  end  sev- 
ernl  others  (all 
Discrete) 

Simacript  II. 5 
(Diacreta) , 
C-Simacript, 
(Dlsctete, 
Continuous 
and  Combined) 

SIMULA  67 
(Discrete) 

SLAM  (Discrete, 
Continuous,  and 
Combined) 

Implementation 

Language 

FORTRAN  or  PL/l 

Assembly 

Machine 

ALGOL 

FORTRAN 

Computer  System 

Any  computer  hav¬ 
ing  a  FORTRAN  or 
FL/1  compiler 
(come  commercial 
time-sharing  sys¬ 
tems) 

Most  large  com¬ 
puters  (several 
commercial  time¬ 
sharing  systems) 

Mott  large 

computers 

(several 

commercial 

time-sharing 

systems) 

Most  large 
computers 

Any  computer  hav¬ 
ing  e  FORTRAN  com¬ 
piler  (some  com¬ 
mercial  time-sharing 

systems) 

Language  Orientation 

Statement 

Block 

Statement 

Statement 

Statement  or  Network 

World  View  (Discrete)  Event 

Process  (trans¬ 
action) 

Event  or 
Process 

Process 

Event  and  Frocaee 

Storage  Management 

Fixed 

Dyanmic 

Dynamic 

Dynamic 

Fixed 

Language  Type 

Compiler 

Interpreter 
(OPSS/Hi  Compiler) 

Compiler 

Compiler 

Subprogram  Library  / 
Compiler 

Language  Purchase 
Coat 

Inexpensive 

Moderate 

Moderate 

Moderately 

Expensive 

Inexpensive 

References 

[U.  15.  16) 

(2,  6,  B,  23] 

[3,  20,  21] 

[1.  9] 

[IB] 
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6.  FUTURE  DEVELOPMENTS 

Simulation  languages  have  been  evolving  since  the  early  1960's  and  this  trend  should  continue  Into  the 
foreseeable  future.  Some  of  the  simulation  language  developments  expected  In  the  near  future  are  (1)  In¬ 
creased  modelling  capability  provided  directly  In  the  languages  Buch  as  that  provided  by  the  new  language 
SLAM,  (11)  options  for  modal  data  collactlon  and  statistical  analysis  provided  directly  In  the  languages, 
(111)  languages  having  interactive  capability  for  programming,  debugging,  and  model  analysis,  (iv)  lan¬ 
guages  using  computer  graphics  for  modelling,  programming,  validation,  and  analysis,  (v)  languages  for 
minicomputers,  (vl)  reduced  computation  (modal  run)  time  due  to  improvements  In  the  languagea  themselves, 
e.g.,  more  efficient  future  event  set  algorithms  (McCormack,  at  el.,  1979),  and  (vii)  Incraaaad  number  of 
special  purpose  simulation  languages. 

7.  CONCLUSIONS 

As  systsms  become  larger,  mors  complex,  and  costlier,  the  use  of  modelling  will  inersaas,  In  particular 
the  use  of  simulation  modelling.  A  large  percentage  of  simulation  models  developed  today  use  a  simulation 
language  and  this  percentage  will  increase  as  the  capabilities  of  the  simulation  languages  continue  to 
evolve.  This  paper  provided  an  Introduction  to  the  selection  and  use  of  languages  for  simulation. 
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SUMMARY 


This  papar  is  a  tutorial  paper  on  how  to  obtain  point  and  interval  estimates  (confidence  intervals)  of 
means  for  both  terminal  and  steady  stata  simulations.  The  simple  methods  of  replication,  batch  means, 
and  regenerative  cycles  are  presented  in  detail  and  applied  to  a  model  of  a  simple  time-shared  computer 
system  to  illustrate  their  use.  A  brief  dlacueelon  is  included  on  sequential  procedures  and  time  series 
mathoda  for  obtaining  these  estimates.  The  advantages  and  disadvantages  of  the  various  methods  era  given, 
Including  specific  recommendations  as  to  when  certain  methods  might  be  used. 

1.  INTRODUCTION 

The  principal  goal  of  most  simulation  studies  is  to  investigate  the  behavior  of  a  system.  This  Is  accom¬ 
plished  by  developing  a  simulation  model  of  the  system  of  interest  and  investigating  its  behavior  by  per¬ 
forming  either  a  steady  state  or  a  terminating  anaysls  on  the  model's  output  data  (Law,  1979a).  In  steady 
state  analysis,  we  are  interested  in  estimating  parameters  whose  values  are  constant  with  respect  to  time. 
This  implies  that  the  statistical  properties  of  all  of  tha  model's  variables  aro  time  invariant,  i.a., 
stationary,  after  a  delay  cf  at  most  a  short  period  of  time  determined  by  the  model's  initial  conditions 
(stata) .  An  example  of  steady  state  analysis  1s  determining  the  mean  waiting  time  of  customers  in  a  sys¬ 
tem  assuming  the  intararrival  and  service  times  are  time  invariant  and  steady  state  occurs. 

In  terminating  analysis,  we  era  interested  in  analysing  the  model's  behavior  over  a  finite  time  period 
which  may  be  of  fixed  or  of  random  length.  Examples  of  terminating  analysis  are  (i)  determining  how  many 
days  it  takes  to  fill  an  empty  raservior  assuming  a  random  input,  (it)  determining  how  many  customers  are 
served  in  a  store  opened  from  8  to  5,  (iii)  determining  the  length  of  time  a  new  system  operates  until 
its  first  failure,  (iv)  determining  the  expected  change  in  the  gross  national  product  between  1979  and 
1989,  and  (v)  determining  the  offset  of  a  five  percentage  yearly  harvest  of  whales  between  1980  and  2050. 
In  terminating  simulations  tha  results  are  a  function  of  the  state  of  the  model  at  the  beginning  of  the 
finite  time  period  (model's  initial  conditions)  of  interest. 

The  minimum  statistical  analysis  that  should  ba  performed  in  both  steady  state  and  terminating  analysis  is 
to  obtain  point  and  interval  estimates  of  the  means  of  the  output  variables  of  interest,  Unfortunately,  a 
comprehensive  statistical  methodology  for  analyzing  simulation ‘output  data  remains  to  bs  developed.  This' 
frequently  leads  to  simulation  studies  having  inadequate  statistical  analysis  performed  on  their  output 
data.  Far  too  often  only  point  estimates  of  tha  means  of  the  output  variables  are  obtainad  without  any 
determination  of  how  good  they  are,  i.e,,  no  confidence  Intervals  (Interval  estimates)  are  determined. 

There  are  statistical  methods  of  analysis  that  can  be  used  to  obtain  both  point  and  interval  estimates  of 
tha  maann  of  simulation  output  variables  for  both  steady  state  end  terminating  simulation  atudiee.  Tha 
objactlva  of  thia  tutorial  paper  is  to  describe  the  simpler  methods  of  obtaining  point  and  interval  esti¬ 
mates  of  ths  means,  Including  their  advantages  and  disadvantages,  with  the  hope  that  better  statistical 
analysis  will  ba  performed  in  simulation  studies. 

After  a  simulation  model  has  been  verified  and  validated  (Sargent,  1978  and  1979),  the  model  is  ready  to 
have  experiments  performed  on  it  to  obtain  a  set  of  output  observations  (data)  for  analysis.  The  output 
obssrvstiona  are  in  general  not:  independent  but  correlated,  ueually  positively.  This  complicates  obtain¬ 
ing  Interval  estimates  of  the  mean.  Because  the  method  of  analysis  commonly  used  for  obtaining  point  and 
interval  estimates  of  terminating  simulations  is  one  of  the  methods  used  in  steady  state  analyaia,  we  will 
restrict  our  discussions  to  steady  state  analysis  except  for  Section  7. 

In  performing  e  steady  state  analysis,  s  set  of  initial  conditions  must  be  put  into  the  simulation  model 
which  will  usually  cause  the  model  to  go  through  a  transient  response  prior  to  reaching  a  steady  state. 

(We  era  assuming  that  tha  model  under  analysis  has  a  steady  state  mean.)  The  analyst  must,  in  addition  to 
determining  the  model's  Initial  conditions,  decide  what  method  of  data  collection  and  data  analysis  to  uae 
under  a  constraint  of  a  fixed  number  of  observations  because  the  amount  of  computer  time  is  generally 
limited.  Since  the  steady  state  observations  are  usually  correlated,  data  must  ba  collected  in  a  way  to 
obtain  independent  observations  to  allow  classical  statistics  to  be  used  or  time  series  techniques  used. 

The  three  data  collection  method*  uaed  to  obtain  Independent  observations  are  (1)  the  method  of  replica¬ 
tion,  (2)  the  method  of  batch  means  (subintervale),  end  (3)  the  regenerative  method.  The  analyst  must 
choose  one  of  the  above  three  methods  of  date  collection  and  use  classical  statistical  analysis  or  chooso 
on*  of  the  following  time  aeries  methods!  spectral  analysis,  autocorrelation,  autoregressive,  or  auto¬ 
regressive-moving  average.  Classical  statistical  analysis  is  generally  used  to  obtain  point  and  Interval 
estimates  of  the  mean  because  using  classical  atatiatical  is  easier  then  using  time  sariee  techniques, 
analysts  frequently  are  knowledgeable  about  classical  statistics  and  time  eerie*  tachnlquas  are  sensitive 
to  proper  application  end  require  knowledge  of  advanced  statistics.  Because  of  these  reasons,  we  will 
deacribe  in  detail  only  the  three  methods  using  classical  statistics. 

The  remainder  of  thie  paper  is  divided  into  seven  sections.  The  next  section  discusses  general  statistics 
that  are  used  in  this  paper.  Section  3  describee  the  three  methods  of  obtaining  independent  observations 
end  their  analyses  snd  Section  4  applies  these  methods  to  a  simulation  study  of  a  Time-Shared  Computer 
System.  Section  5  briefly  discusses  sequential  procedures  end  time  series  methods  of  analysis  end  Section 

*  Thie  paper  is  an  expansion  of  the  paper  "Statistical  Analysis  of  Simulation  Output  Date,"  by  Robert  G. 
Sargent,  contained  in  the  ACM  Proceeding-  - .  the  1976  Symposium  on  the  Simulation  of  Computer  Systems. 


6  discusses  selection  and  comparisons  of  the  various  steady  atate  methods.  Section  7  discusses  analyzing 
terminating  simulations  and  the  last  section  Is  the  conclusions. 

2.  GENERAL  STATISTICS 


Suppose  we  label  a  set  of  observations'  from  a  stochastic  process  x^>  x^,  . ...  x^.  This  aould  be,  for  ex¬ 
ample)  k  output  observations  from  a  simulation  modal.  A  point  estimator  of  tha  mean  u  of  this  stochastic 
process  could  be  obtained  by  using  the  statistic  (a  quantity  calculated  from  sample  observations)  given 
by  (1).  If  tha  observations  x^,  x^,  . . .,  are  independent  and  Identically  distributed  (lid))  which  we 

will  asaume  until  stated  otherwise^  then  several  additional  statements  can  be  made.  First  the  estimator 
x  la  an  unblas  estimator,  l.e.,  E(x^  ■  p .  .Secondly,  an  unblas  point  estimator  of  the  variance  of  x  Is 
given  by  (2).  Statistics,  such  as  x  and  s  ,  are  random  variables  and  have  distributions  called  sampling 
distributions  which  describe  their  behavior.  Tha  variance  of  x  la  given  by  (3)  and  Its  point  estimator  by 
(4).  If  the  variance  of  x  Is  known  and  finite,  then  by  tha  central  limit  theorem  we  have  (3).  In  ganaral, 


(1) 

W 

(3) 

(4) 


2 

tha  variance  of  x  is  not  known,  but  it  can  bu  shown  that  (5)  continues  to  hold  if  its  estimator  s_  is  uaed 
to  replace  'J2  ,  Therefore,  for  large  sample  altos,  the  sampling  distribution  of  x  can  be  approximated  by 

a  normal  x  distribution.  One  generally  considers  sample  size  large  if  k  is  greater  than  forty  (40) 
provided  that  the  distribution  of  x  is  reasonably  well  behaved. 
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If  one  desires  the  exact  sampling  distribution  of  x,  then  the  distribution  of  x  must  ba  known.  In  this 
paper,  we  will  asaume  the  variance  of  the  random  variable  x  Is  unknown  In  discussing  the  sampling  distri¬ 
bution  of  x.  If  the  x^a  ara  lid  and  normally  distributed,  then  the  sampling  distribution  of  mesn  with  k 

obssrvatlona  is  the  t  distribution  with  k-1  degress  of  freedom.  If  the  Xj,'s  ara  not  normally  distributed 

but  can  be  approximated  by  a  normal,  It  is  common  practice  to  use  the  t  distribution  as  the  aampllng  dis¬ 
tribution.  Unfortunately,  many  simulation  output  variables  of  interest  have  «  density  function  that  is 
non-negativu,  unimodal,  and  positively  skewed. 

Since  x  is  a  random  variable,  it  is  usually  desirable  in  practice  to  determine  how  accurate  this  point  es¬ 
timator  is.  This  is  usually  accomplished  by  constructing  a  confidence  interval  for  u.  The  confidence  in¬ 
terval  is  determined  by  choosing  two  point  estimators  in  Buch  a  way  that  one  can  state  a  probability  that 
the  interval  contains  the  mean,  a  fixed  but  unknown  quantity.  In  order  to  obtain  this  confidence  interval, 
the  sampling  distribution  of  x  must  bu  known.  If  the  sampling  distribution  is  a  t  distribution,  the 
100(1-y)X  confidence  Interval  for  u  is  given  by  (6)  where  tfc_^  t*>e  point  of  the  t  distribu¬ 

tion  with  k-1  degrees  of  freedom.  This  implies  that  the  probability  that  the  confidence  interval  given  by 
(6)  contains  the  steady  state  mean  is  1-y.  It  is  also  common  practice  to  use  (6)  ss  the  confidence  inter¬ 
val  of  the  mean  If  the  observations  are  approximately  normal.  As  k  increases,  the  t  distribution  approaches 
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the  normal.  For  large  Bamples,  one  replaces  ^  l-y/2  ^  by  the  l-v/2  point  of  the  standard  normal, 

(p-0,o2«l).  (A  sample  is  generally  considered  largo  if  k  is  greater  than  forty.)  The  t  distribution  is  t 
flatter  diatributlon  than  the  normal  and  its  behavior  is  sucli  that  it  gives  a  larger  value  for  t|(t_ ^ ^  1— -y / 2 ’ 

che  smaller  k  Is.  If  a  more  accurate  estimate  of  x  is  desired,  then  the  number  of  observations  should  bu 
increased  to  reduce  the  variance  uf  the  sampling  distribution.  Onu  should  sIbu  be  aware  that  increasing 
the  probability  that  the  confidence  lnturval  contains  the  moan  causes  the  size  of  the  confidence  interval 
to  increase. 

As  stated  in  Section  l,  most  simulation  output  variables  go  through  a  transient  response  before  reaching 
steady  state  and  the  observations  sro  usually  positively  correlated,  if  the  transient  observations  ate 
included  in  the  enelysle,  this  will  result  in  x  being  a  kies  estimator  of  p ,  the  Btgady  state  mesn.  If  the 
data  is  correlated  and  is  analyzed  as  if  it  is  independent,  the  point  estimate  of  o_  will  be  incorrect. 

x 


Since  simulation  data  is  usually  positively  (negatively)  correlated,  the  variance  of  x  will  be  underesti- 
mated  (overestimated)  resulting  in  a  smaller  (larger)  confidence  interval  for  the  mean  than  is  correct. 

It  should  be  noted  that  most  simulation  languages  that  provide  the  capability  of  calculating  variances 
estimators,  analyze  the  data  as  if  it  is  independent  and,  therefore,  care  should  be  used  as  to  when  it  is 
appropriate  to  use  this  capability. 

If  the  data  of  a  eimulation  output  is  correlated  and  in  steady  state,  wa  have  what  la  called  a  covariance 
stationary  or  wida-aenaa  atationary  stochastic  process.  Correlation  does  not  effect  estimating  the  mean, 
but  does  tha  variance  of  x,  The  autocovariancas  of  the  obaarvationa  ara  given  by  (7)  and  their  point 
eatlmators  by  (8).  The  autocorrelatione  are  given  by  (9)  and  they  lie  between  plue  and  minus  one.  Their 
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point  eetimates,  p(i),  ara  obtained  by  replacing  R^  by  C^.  p(i)  is  usually  poaltlva  for  simulation  output 
data  and  decreases  exponentially  aa  i  increasea.  The  eatimate  of  tha  variance  of  x  is  given  by  (10).  One 

notes  that  if  P  (.1)  is  zero  for  all  i,  than  (10)  Is  the  same  as  (4).  On#  can  readily  aaa  from  (10)  that 
the  variance  of  x  ia  underestimated  (overestimated)  by  tha  values  associated  with  tha  autocorrelations  if 
tha  simulation  data  is  analysed  aa  if  it  is  Independent  and  1b  in  fact  positively  (negatively)  correlated. 
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3.  DESCRIPTION  OP  METHODS  USING  INDEPENDENT  ANALYSIS 

If  the  observations  generated  by  the  simulation  model  are  iid,  than  tha  point  and  interval  eatlmators  dts- 
cribad  in  Section  2  may  ba  used  directly  for  steady  state  means,  Since  simulation  output  observations  ara 
generally  correlated,  then  independent  observations  must  be  obtained  if  classical  utatiatioe  ia  going  to 
be  uaad  for  analyaia.  Tha  three  major  approaches  to  obtaining  independent  observations  and  tha  desired 
*re  described  below,  Additional  information  on  these  methods  can  ba  found  in  Crane  at  al., 
1974a,  1974b,  1975a,  1975b,  1977,  Fishman,  1978,  Kleijnon,  1974,  1975,  Law,  1977,  1979a,  1979b,  and 
Pritskar  et  al.,  1979. 

3.1  The  Method  of  Replication 

The  method  of  replication  ia  defined  as  making  k  independent  simulation  rune  (replication!)  of  length  m 
observations  each  for  a  total  of  N  observations.  The  independence  of  runs  la  accomplished  by  ualng  a 
different  stream  of^random  numbers  for  each  run  and  the  same  Initial  conditions.  Let  x^j  ba  the  Jth  ob¬ 
servation  of  the  1th  run  and  Rj^  be  the  average  of  the  ith  run.  By  definition  the  R^s  are  ild.  Using 
ths  Rj's  in  (1)  and  (2),  the  point  estimators  for  the  steady  state  moan  p  and  the  variance  of  the  R^'a 
are  obtained,  respectively.  Using  the  a2  calculated  by  (2)  in  (4),  a*  is  obtained.  The  confidence  inter¬ 
val  of  M  ia  obtained  by  using  (6).  Before  using  the  R  '*  described  x  above  to  calculate  point  and  in¬ 
terval  estimates  of  tha  steady  state  mean,  u.  one  must  consider  two  ucsnihln  inurra,  nf  fn,  rt... 


estimates. 


If  ear  .  run  goes  through  a  transient  response  before  reaching  steady  state  and  the  tranalent  observations 
are  included  in  calculating  the  R^'s,  then  x  will  be  a  bias  estimator  of  the  steady  state  mean  p*  One  must 

be  careful  of  obtaining  a  bias  in  x  because  the  confidence  interval  is  around  x,  particularly  whan  k  la 
large  because  the  confidence  interval  dacraaaaa  aa  k  Increases.  It  ia,  therefore,  common  practice  to 
delate  a  fixed  number  of  observations  (the  transient  observations)  from  tha  beginning  of  each  run  bafora 
calculating  the  R^  a  in  order  to  eliminate  tha  bias.  Howavar,  aa  one  eliminates  observations  in  calcula¬ 
ting  the  Kj  s,  the  variance  of  x  increases  resulting  in  a  larger  confidence  interval.  This  meins  that  a 
trada-off  must  be  made  between  a  possible  biae  in  x  and  the  size  of  the  confidence  interval.  The  diffi¬ 
culty  ia  that  there  ia  not  any  procedure  currently  known  to  determine  how  many  obaarvationa  to  delate 
(Oafarian,  at  al.,  1978,  and  Wilson  et  al.,  1978a). 

The  second  source  of  possible  error  is  it'  the  distribution  of  the  R, ’a  ara  non-normal.  This  causa*  tha 
sampling  distribution  of  x  not  to  have  a  t  distribution  and,  therefore,  using  (6)  will  generally  raault  in 
incorrect  confidence  intervals,  One  wey  to  eliminate  the  non-normality  effect  la  to  use  a  large  simple 
siso  (large  k) ,  bringing  into  effect  the  central  limit  theorem.  However,  this  approach  increanaii  tha  num¬ 
ber  of  transient  observations  which  must  be  eliminated  to  avoid  a  bias  in  x.  If  only  a  fixed  number  of 
observations  can  be  obtained,  the  few-'.r  observations  that  are  eliminated  due  to  transient  responses, 

the  better,  because  this  will  result  in  a  shorter  confidence  interval.  Increasing  m  will  usually  cause 
the  R^'s  to  approach  a  normal,  but  at  a  slower  rate. 


3.2  The  Method  of  Batch  Means 


The  method  of  batch  means  (subintervals)  is  defined  as  dividing  one  simulation  run  of  length  Nix^.x^ .... ,  x^) 

into  k  batches  (segments)  of  m  observations  each.  If  we  let  B,  be  the  average  of  the  m  observations  in 
batch  1  and  choose  m  sufficiently  large,  then  the  B^'s  should  5c  essentially  uncorrelated.  If  the  b.’s 

are  uncorrelated  and  are  normally  distributed,  then  they  are  also  independent.  Even  if  the  B.’a  are  not 
normal,  it  is  common  practice  to  assume  that  they  era  independent  il  they  are  uncorrelated.  One  method 
used  to  determine  if  the  B.'a  era  unoorrelatad  is  to  estimate  their  correlations  using  tha  formulas  given 
in  Section  2.  Soma  recant1  empirical  avldanca  (Duket,  at  al.,  1978  and  Law,  1977)  haa  emerged  that  these 
formulas  may  have  biases  for  analyzing  data  such  that  the  estimates  ara  lower  than  the  actual  valusa .  If 
this  is  true  than  one  may  belisve  the  B.'s  are  uncorrelated  when  in  fact  they  are  positively  correlated. 

A  more  accurate  method  is  to  use  the  one  recommended  by  Fishman,  1978.  One  notes  that  the  method  of  batch 
means  has  only  one  transient  response  compared  to  the  method  of  replication  which  has  a  transient  response 
for  each  replication. 

The  point  estimators  x  and  s  ara  obtained  by  using  the  B.'s  in  (1)  and  (2).  The  confidence  Interval  for 
p  is  obtained  by  using  (4)  and  (6).  There  ere  three  possible  sources  of  error  in  using  the  B.'s  to  calcu¬ 
late  the  point  and  interval  estimates  of  Che  mean.  If  there  is  a  transient  response  and  tha  1  transient 
observations  are  used,  then  x  will  be  a  bias  estimator  of  the  steady  state  mean  p  unless  they  are  delated 
as  discussed  under  the  method  of  replication.  It  is  common  practice  to  delete  the  transient  observations 
prior  to  dividing  the  run  into  batches  for  analysis. 

The  second  source  of  possible  error  is  that  the  distribution  of  the  B.'s  may  be  non-normal.  This  could 
cause  tha  confidence  interval  to  be  Incorrect  as  discussed  above.  A  1  large  sample  size  (a  large  k)  could 
also  be  used  to  bring  the  central  limit  theorem  into  effect  for  the  sampling  distribution  of  x.  This  would 
not  increase  the  number  of  transient  observations  as  in  the  method  of  replication. 

The  third  possible  source  of  error  is  that  the  B.'a  may  be  poeltlvely  (negatively)  correlated.  If  they  are, 
the  variance  of  x  will  be  underestimated  (overestimated)  aa  discussed  in  Section  2.  This  would  result  in  a 
smaller  (larger)  confidence  interval  than  is  correct.  To  avoid  the  possibility  that  the  B.'s  are  uncorra- 
lated,  the  size  of  each  batch  should  be  as  large  as  possible  (large  m).  For  a  fixed  N,  a  1  trade-off  muse 
be  made  between  the  size  of  k  and  m,  which  may  eliminate  using  a  large  sample  size  (large  k)  to  anable  the 
sampling  distribution  to  become  approximately  normal  if  the  B^'e  are  non-normal.  One  must  also  remember 
that  Increasing  m  will  cause  the  B^'s  to  approach  normality  1  if  the  x^'s  are  non-normal. 

3.3  The  Regenerative  Method 

The  regenerative  method  is  defined  aa  dividing  a  simulation  run  into  a  sequence  of  lid  Intervals,  called 
cycles,  by  uaing  regenerative  points.  A  model  or  system  Is  regenerative  if  it  hee  at  laaat  one  state  in 
which  future  behavior  ie  independent  of  peat  behavior.  Each  timu  the  model  entere  thie  state,  a  regenera¬ 
tive  point,  it  terminates  a  cycle  end  starts  a  naw  one.  If  this  method  of  analyais  la  to  be  applicable, 
tha  expected  time  between  regenerative  pointi  must  be  finite  and  the  simulation  model  must  be  able  to 
generate  a  large  number  of  regenerative  pointi  bacauaa  the  campling  distribution  is  derived  based  on  tha 
central  limit  theorem.  If  ragenerative  points  do  not  exist,  this  method  cannot  be  used  unlase  approximate 
regenerative  techniques  are  appropriate  (Crane,  at  al.,  1975b,  1977). 

The  reguncrative  method  provldei  a  way  of  obtaining  point  and  interval  estimates  of  E(f(X)).  Examples  of 
E(f(X))  are  E(X),  E(X)  ,  and  F(X"0),  where  X  can  be  a  random  variable  for  the  ateady  state  welting  time, 
ateedy  itato  number  ie  queue,  staady  state  coat,  etc.  Thie  method  la  more  general  than  the  two  previous 
methods  because  it  can  obtain  point  and  interval  eatimatos  for  any  K(f(X)), 

Let  us  define  a  sequence  of  regenerative  points  (timee)  as  0  £  <  P2  <  <  ...  ,  If  the  initial  con¬ 

ditions  are  chosen  such  that  the  state  of  the  model  Is  at  a  regenerative  point,  no  observations  need  ob 
eliminated  at  the  beginning  of  a  simulation  run;  if  not,  then  B,  is  the  first  regenerative  point  to  occur 
in  the  simulation  run.  If  more  than  one  sequence  of  regenerative  points  occur  in  a  simulation  model,  the 
analyst  should  usually  choose  the  sequence  having  the  largest  number  of  cycles  to  hopefully  obtain  the 
best  estimate  (smallest  confidence  interval).  A  state  that  frequently  creates  regenerative  points  in  an 
open  queueing  model  is  leaving  the  empty  and  idle  state  (Fishman,  1978), 

For  each  cycle  i,  defined  as  the  time  interval  between  and  B^,  a  Y^  and  must  be  chosen  such  that 
(11)  holds,  oij  is  soma  measure  of  the  size  of  the  cycle,  usually  either  the  length  or  a 

count  of  the  number  of  entities  data  Is  collected  on  in  cycle  1,  end  Y,  is  usually  either  a  sum  of  the 
f(X)'s  that  occurred  during  cycle  i  or  is  found  by  integrating  f(X)  1  over  cycle  i.  Examples  are 

*(*<»>  -fgf  (U) 

(a)  E(f (X) )  -  mean  waiting  time,  then  Y^  ie  the  Bum  of  waiting  times  in  cycle  i  and  «1  is  tho  number  of 
entitles  whose  waiting  tlmeB  are  in  Y^j  (b)  E(f(X))  ■  mean  number  in  queue,  then  Y^  is  obtained  by  inte¬ 
grating  the  number  in  queue  over  cycle  i  and  1b  the  length  of  cycle  i;  end  (c)  E(f(X))  ■  probability  a 

server  is  idle,  the  Y.  ie  the  length  of  time  the  Berver  is  idle  during  cycle  i  and  o,  1b  the  length  of 
cycle  1.  1 

For  k  cycles,  a  sot  of  observations,  Y^,  Y^,  ....  Y^  and  a^,  a^,  ....  are  obtained.  SincB  the  cycles 
are  lid,  tho  Y^'s  are  lid,  the  a^'s  are  lid,  and  the  Y^'s  are  usually  highly  correlated  with  the  a^'s. 

There  are  several  point  and  Interval  estimators  that  can  bu  used  for  K ( f (X) ) .  (Please  note  that  we  must 
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use  a  ratio  estimator  because  both  the  numerator  and  denominator  are  random  variables.)  They  are  a  func¬ 
tion  of  statistics  (12)  through  (16).  The  classical  point  estimator  of  E(f(X))  is  given  by  (17)  and  is  a 
bias  estimator.  If  ue  define  the  100(l-y)%  confidence  interval  of  E(f(X))  by  rc  +  dc>  then  the  classical 

point  estimator,  dc,  Is  given  by  (19),  assuming  a  largo  sample  size  such  that  sampling  distribution  can  be 
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approximated  by  a  normal  by  the  use  of  the  central  limit  theorem.  In  (19)  **  tke  9<>int  of 

the  standard  normal.  The  Jackknife  method  gives  better  point  and  interval  estimators  of  E(f(X))  than  the 
classical  method,  in  particular,  for  small  sample  sizes.  The  jackknife  point  estimator  is  given  by  (20) 

r  -  l  (17) 
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and  using  dj  from  (21),  the  confidence  interval  for  p  is  rj  +  dj .  The  classical  and  Jackknife  estimators 

presented  here  as  well  as  others  are  discussed  in  Tnglehart,  1975.  One  should  note  that  both  the  classi¬ 
cal  end  Jackknife  methods  give  better  results  than  the  estimators  given  in  the  original  Crane  and  Iglehart 
papers  (1974a,  1974b,  1975a,  1975b)  and  which  have  become  widely  disseminated. 
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There  is  one  possible  source  of  error  in  using  the  regenerative  methods  described.  The  sampling  distribu¬ 
tion  used  in  developing  confidence  intervals  for  E(f(X))  is  obtained  by  using  the  central  limit  theorem. 
Therefore,  if  a  large  sample  is  not  used,  the  sampling  distribution  may  not  be  a  normal.  One  should  note 
that  the  transient  response  is  not  s  concern  with  this  muthod.  If  one  chooses  to  run  a  simulation  for  s 
fixed  period  of  time,  it  may  not  end  at  a  cycle.  In  this  case,  one  uses  the  number  of  full  cycles  gener¬ 
ated  for  data  analysis  and  neglects  the  portion  of  a  cycle  left  at  the  and  of  the  run. 

4.  A  CASE  STUDY 

Let  us  npnly  the  data  anlysis  techniques  presented  in  Section  3  to  simple  tlme-aharad  computer  model 
(Adirl,  1969).  The  model  will  consist  of  NT  terminals,  one  CPU  with  round  robin  scheduling  (a  single 
queue  with  first  come  first  serve  discipline),  iid  think  times  that  have  an  exponential  distribution  with 
a  mean  of  1/ A  ,  service  time  requests  that  are  lid  with  an  exponential  diatirbution  with  a  mean  of  l/A^, 
a  maximum  1  service  quantum  of  length  q  (not  including  overhead),  a  fixed  overhead  of  length  t  for 
every  time  slice  independent  of  the  length  of  the  quantum.  This  model  is  given  in  Figure  1.  Let  the 
abjective  of  the  simulation  study  be  to  determine  the  point  and  interval  estimates  of  the  mean  steady 
state  response  time,  where  response  time,  RT,  is  defined  as  the  time  from  when  a  job  leaves  the  terminal 
until  it  returns  (the  time  between  think  times).  The  expected  response  time  for  this  model  can  be  cal¬ 
culated  aB  In  Adlri.  1969.  The  model  wsb  programmed  in  SIMSCRIPT  11.5  and  run  on  an  IBM  computer. 

4.1  Initial  Conditions  and  Transient  Responses 

In  order  to  simulate  this  time-shared  computer  model,  a  set  of  Initial  conditions  must  be  selected.  When 
one  Is  interested  in  steady  state  behavior,  it  is  desirable  to  select  the  Initial  state  as  ■  typical  state 
in  steady  state  to  reduce  the  length  of  the  transient  response  (Conway,  1963).  We  are  going  to  select  for 
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Chla  caaa  atudy  an  initial  state  that  generates  regenerative  point*.  Thia  atate  nay  not  ba  a  typical  atat* 
in  ataady  atat*  (it  uy  not  b*  for  a  heavy  load  on  th*  nodal).  The  Initial  atat*  or  condition*  aelectad 
i a  whan  a  Job  laavsa  th*  couputur  and  it  go**  ldl*.  Thia  naana  all  Job*  are  in  the  think  atat*.  Thia 
atate  generate*  regenerative  point*  bacauae  think  tinea  are  exponential  and  the  exponential  dlatrlbution 
haa  th*  forgetfulnaaa  (Markov)  property. 

Aa  stated  in  the  previous  section,  there  does  not  axiat  any  quantitative  procedure  to  daternin*  when  a 
nodal's  transient  response  ends  and  th*  ataady  atat*  response  begins.  Most  simulation  uaara  alaply  make 
an  "aducatad  guess"  considering  such  factors  as  (1)  analysis  of  some  realisations  (replication*)  of  inter- 
sat,  (2)  cost  of  obtaining  observations,  (3)  concern  for  transient  effect,  (A)  variability  of  the  modal's 
behavior,  and  (5)  congestion  in  th*  model. 

This  author  likes  to  make  three  replications  and  plot  the  accumulative  moving  average  of  th*  output  of  in¬ 
terest  and  use  thasa  in  conjunction  with  the  factors  given  above  in  making  hia  "educated  guess"  whan  th* 
steady  state  response  begins.  Typically  the  output  will  either  ovarshoot  the  naan  value  and  have  a  damped 
oscillation  or  simply  converge  on  the  steady  stats  value.  Both  of  than*  types  of  response  will  have  ran¬ 
dom  fluctuations  in  them.  The  purpose  of  using  three  runs  is  to  be  able  to  evaluate  th*  randomness  of  tha 
output  between  runs  and  to  daternin*  what  fluctuations  mean  in  a  given  run.  On*  must  remember  in  analys¬ 
ing  th*  outputs  that  you  ar*  observing  sn  accumulative  moving  average,  Two  difficulties  in  naklng  these 
runs  are  (1)  what  length  should  they  be,  and  (11)  what  interval  should  th*  accumulative  moving  average  be 
printed  out.  The  run  length  cun  always  bo  continued  if  appropriate  Information  is  kspt  on  the  state  of 
the  model  at  the  and  of  a  run  to  ba  uaed  aa  tha  input  for  continuing  a  simulation  run.  The  interval  chosen 
haa  to  be  large  enough  ouch  that  some  of  tha  randomness  In  the  output  la  smooth,  yet  frequently  enough  to 
obaerva  the  mean  behavior. 

Figure  2  contains  two  seta  of  throe  rune  of  the  tlmu  sharing  model,  one  under  medium  load  (NT"!})  and  the 
other  under  a  heavy  load  (NT-35).  These  runa  are  longer  then  necessary  to  illustrate  the  bahavior  of 
realisations  of  a  simulation  model.  The  accumulative  moving  average  wa*  printed  out  ovory  20  obaarvatlona. 
Two  different  aeruame  of  random  numbers  are  used  in  each  run,  one  for  the  think  timaa  and  the  other  for 
earvice  timaa,  Tha  aano  streams  are  uaed  in  tha  model  for  the  transient  response  labeled  with  the  seme 

number .  For  NT  equal  to  35,  one  can  readily  see  that  heavy  congestion  (heavy  load)  in  a  model  causes  more 

variability  and  a  longer  transient  response  than  lower  congestion.  Some  of  these  realisations  illustrate 

how  a  transient  response  overshoots  the  mean  and  damps  out  and  others  illustrate  converging  to  the  mean. 

This  author  would  consider  the  transient  response  ended  between  200  and  300  observations  for  NT  uqual  to 
25  and  between  600  and  700  observations  for  NT  equal  to  35. 

A. 2  Steady  State 

let  us  determine  point  and  intervnl  estimators  of  the  steady  state  mean  response  time  of  the  time-shared 
computer  model  with  1/X^  -  25,  1/A ?  -  0.8,  t  ■  0.015,  q  -  0,1  end  NT  -  25,  with  the  unite  being  secondM, 

using  the  three  methods  presented  in  Section  3.  This  sot  of  parameter  values  giva  a  ataady  state  mean  of 
3.A15  eeconds  end  is  the  medium  load  case  discussed  under  initial  conditions  and  tranalant  responses  abova, 
Us  will  use  tha  asms  initial  conditions  given  above  for  all  our  steady  state  investigations. 

For  sach  of  the  three  methods,  results  will  be  presented  using  two  replications  of  the  experiment  to  illua- 
trate  the  variability  that  can  occur  butwean  experiments.  For  the  Batch  and  Regenerative  Methods,  th* 
scream*  of  random  nuubars  uaed  to  generate  realisationa  (1)  and  (2)  in  Figure  2  ar*  uaed  for  tha  experi¬ 
ment*  (rune)  one  and  two,  respectively.  The  output  data  from  oach  experiment  la  analysed  In  various  ways 
by  varying  k,  m,  N,  and  the  number  of  observations  delated  for  the  transient  response  to  illustrate  how 
the  result*  can  differ  depending  how  the  analysis  is  performed.  One  must  not  draw  general  eonolualons  from 
tha  data  praaanted  because  of  the  variability  that  occurs  between  experiments,  the  differences  that  occur 
In  a  modal's  bahavior  for  different  loade,  and  the  differences  that  occur  between  different  models.  Tha 
two  experiments  performed  are  actually  what  did  happen  in  performing  two  experiment*  (they  ware  not  aelsc- 
ted  from  several  experiments).  One  can  readily  see  from  Figure  2  that  tha  accumulative  moving  average  of 
realisation  (2)  never,  once  became  equal  to  or  greater  than  the  steady  state  mean  In  1,000  observations. 
Realisation  (1)  converges  very  close  to  the  expected  value  during  1,000  observations. 

Tha  distribution  of  response  time  in  steady  state  is  non-negative,  unimodel,  anil  he*  a  long  poaltlvu  tall 
(Anderson,  et  al.,  1)72,  197A),  i,s.,  positive  skewness  (skewness  is  *  measure  of  asymmetry  of  the  distri¬ 
bution  about  the  mean  and  it  la  poeitlve  because  the  tail  is  in  the  positive  direction).  To  illustrate 
the  behevlor  of  thu  response  time  distribution  s  frequency  distribution  of  the  data  in  realisation  (1)  dis¬ 
cussed  above,  ie  given  in  Table  1,  One  can  readily  eae  that  thu  distribution  ha*  a  long  positive  toil  and, 
therefore,  does  not  have  a  normal  dlatrlbution.  ' 

Our  methods  of  analysis  uses  averages  of  observation*  and  it  is  the  distribution  of  th***  avtragt*  that 
must  b*  normal  to  obtain  an  exact  or  approximate  sampling  distribution.  If  the  observations  ussd  to  cal- 
culat*  the  averages  are  normal,  then  the  averages  will  be  normal.  If  the  observations  are  not  normal,  th* 
distribution  of  the  average*  will  approach  a  normal  a*  th*  number  of  observations  In  th*  average*  increase. 
(Not*  that  the  well  known  central  limit  theorem  cannot  be  applied  directly  because  our  observations  ar* 
correlated,  however,  the  average*  still  approach  a  normal  distribution  but  st  a  slower  rate.)  Table  1  con¬ 
tains  frequuncy  distributions  for  25,  50  and  100  observations  in  the  averages  for  rsalisation  (1).  Ons 
observes  that  as  th*  number  of  observations  in  th*  averages  (block  else)  increases,  th*  distribution  ap¬ 
proaches  a  normal.  An  eatimato  of  the  covfflcisnt  of  akuwnssa  for  each  of  the  three  distributions  are  in¬ 
cluded  In  Table  1.  This  quantlfis*  the  effect  of  increasing  m. 

If  observations  of  response  time  are  collected  from  the  model  one  aftor  another,  the  observation!)  will  be 
positively  correlated.  Table  2  gives  estimates  of  the**  correlation*  using  the  formulae  given  in  Section  2 
for  realisation  (1)  after  rumovlng  the  firat  200  observations.  Th*  correlation  decrease*  as  the  lag  in¬ 
creases  and  ono  could  estimate  that  the  correlation  Is  sero  after  a  lag  of  fourteen  for  tills  set  of  data- 

in  using  this  method  of  batch  moans,  uc  must  select  th*  number  of  observations  in  each  batch  large  enough 

such  that  thu  hatch  moans  are  Independent.  This  Is  dstsrmined  by  looking  at  the  correlation  of  the  batcli 


means.  If  we  use  a  batch  size  of  20  observations!  correlation  estimates  using  realization  (1)  ara  given 
in  Table  2.  There  la  some  positive  correlation  for_lag  one  but  is  zero  for  larger  lags.  This  indicates 
we  would  most  likely  underestimate  the  variance  of  x  if  we  used  20  observations  in  each  block.  Uaing  40 
observations  in  a  block,  we  obtain  an  estimate  of  the  first  lag  to  be  0.011  for  realization  (1)  and, 
therefore,  the  blocks  are  uncorrelated  for  blocks  of  size  40.  This  analysis  indicates  that  the  block  size 
should  be  greater  than  20  but  does  not  need  to  be  greater  than  40.  Further  analysis  can  be  dona,  if  de¬ 
sired.  Fishman,  1978,  gives  a  different  test  statistic  and  a  test  to  be  used  to  determine  if  the  batches 
ara  correlated.  He  recommends  doubling  the  size  of  the  batch  until  the  teat  is  satisfied. 

4.3  The  Method  of  Batch  Means 

Table  3  contains  the  results  of  using  realizations  (1)  and  (2)  for  experiments  (runs)  one  and  two,  respec¬ 
tively,  for  various  values  of  N,  the  total  number  of  observations,  for  k,  the  number  of  batches,  for  m, 
the  size  of  each  batch,  and  for  different  number  of  observations  deleted  at  the  beginning  of  a  run  (tran¬ 
sient  observations).  The  data  for  N  equal  to  1,000  art  the  first  1,000  observations  of  N  equal  to  2,000, 
etc.,  fer  each  of  the  runs.  .The  estimates  are  obtained  as  explained  in  Section  3.  x  is  the  point  estimate 
of  the  mean  response  time,  si  is  the  point  estimate  of  the  variance  of  the  batches,  and  d  is  the  half  width 
of  the  902  confidence  intervil  for  the  moan,  when  d  is  calculated  using  formula  (6).  The  size  of  each 
block,  m,  is  determined  by  subtracting  the  number  of  observations  delated  (Mo.  Dal.)  from  tha  beginning  of 
each  run  from  the  total  number  of  observations,  N,  and  dividing  the  difference  by  the  number  of  batches,  k. 
For  example,  with  N  equal  to  1,000,  k  equal  to  5,  and  tha  number  deleted  equal  to  zero,  m  equals 
(1,000  -  0) / 5  *  200  obrervations,  Mote  that  the  estimate  of  the  mean  is  not  affected  by  the  trade-off  be¬ 
tween  m  and  k  for  a  given  set  of  observations.  Those  confidence  intervals  that  do  not  contain  tha  mean  is 
indicated  by  an  *  on  d. 

The  results  in  Table  3  show  what  is,  in  general,  expected,  x,  the  estimate  of  the  steady  state  mean,  ap¬ 
proaches  E(X)  ■  3.413  as  N  becomes  large.  Deleting  transient  observations  at  the  beginning  of  tha  run  has 

only  a  limited  effect  on  x  because  of  the  values  of  N  being  used. and  the  behavior  of  the  model  for  the  set 

of  model  parameters  being  usad.  The  difference  between  x  and  if  in  the  two  runs  is  considerable,  especial¬ 
ly  for  N  equal  to  1,000,  illustrating  tha  variability  between  experiments.  The  variance  of  tha  batch  aver¬ 
ages  should  decrease  as  the  size  of  m  increases  for  a  fixed  k  and  the  valuaB  of  el  do.  The  values  for  d 
for  different  values  of  k,  m,  etc.  is  determined  by  tj_Y^2  k-i  ■_  •  *  function  of  k  and  a*.  Tha 

ratio  of  t  s5  ^  to  t  is  1.265  and,  therefore,  the  value  of  t  doeS  not  have  e  significant  effect. 

The  major  effect  is  what  happens  to  a£.  for  a  fixed  N  in  tha  trade-off  between  k  end  m.  This  effect  la 
problem  dependent.  The  reeults  in  x  Table  3  show  that  for  M  equal  to  1,000  and  2,000,  d  increases  as  k 
decreases  and  for  N  equal  to  4,000.  d  remains  about  the  same.  As  N  increases,  d  decreases  for  a  given  k, 
as  expected. 

These  results  do  not  determine  how  accurate  the  coverage  ie,  i.t.,  does  the  902  confidence  interval  ob¬ 
tained  from  the  t-dlstribution  actually  contain  902  of  the  actual  campling  distribution.  One  notee  that 
three  of  the  confidence  intervale  do  not  contain  tha  maan  and  this  occurs  for  experiment  two  whan  H  equals 
1,000.  This  occurs  because  x  is  a  low  estimate  of  u  and  the  confldanca  interval  it  not  large  enough  to 
contain  tha  mean.  For  N  equal  to  4,000,  d  is  less  than  102  of  p,  the  steady  state  mean. 

4.4  The  Regenerative  Method 

Table  4  contains  the  results  of  analyzing  realizations  (1)  and  (2)  by  the  regenerative  method  using  tha 
classical  estimators  for  various  numbers  of  cycles.  The  number  of  observations  is  also  glvan  in  Table  4 
to  enable  a  comparison  between  the  regenerative  method  and  the  batch  and  replication  methods  of  analysis 
whose  results  are  given  by  the  number  of  observations. 

In  analyzing  the  data  in  Table  4,  one  observes  that  r^  converges  to  the  steady  state  mean  and  becomes 
smaller  aa  the  number  of  cycles  and  observations  increases,  ub  Is  to  be  expected.  The  coveragecof  tha 
confidence  intervals  cannot  be  determined  from  the  data  presented.  A  902  confidence  interval  was  used. 

In  experiment  two,  six  of  the  confidence  intervals  do  not  contain  the  mean,  including  one  having  226  cyclas 
with  975  observations.  In  analyzing  these  two  realizations  (data  not  presented),  most  cycles  have  a  small 
number  of  observations  and  the  remainder  a  large  number  of  observations.  This  means  that  there  is  a  large 
variability  and  these  two  experiments  illustrate  that.  One  notes  that  the  size  of  the  d's  ere  approximately 
102  of  p  for  450  cycles. 

4.5  The  Method  of  Replication 

Table  5  contains  the  results  of  two  experiments  using  tha  method  of  replications  for  analysis.  For  each 
of  the  two  experiments  performed,  forty  runs  were  made.  In  the  analysis  of  k  equal  to  forty  (forty  runs), 
twenty  of  these  runs  ware  used  in  the  analysis  of  k  equal  to  twenty,  etc.  The  length  of  the  various  runs 
were  such  to  satisfy  the  total  experiment.  When  N  is  fixed  and  for  a  given  k,  the  size  of  m,  the  number 
of  observations  used  to  determine  each  R.,  is  found  by  dividing  N  by  k  and  subtracting  the  number  of  tran¬ 
sient  observations  deleted  (No,  Del.).  For  example,  if  N  1b  equal  to  1,000,  k  equal  to  5,  and  No.  Del. 
equal  tc  50,  then  m  ie  equal  to  (1,000/5)  -  50  ■  150.  When  N  is  not  given  in  the  table,  m  is  and,  thara- 
fore,  N  can  be  calculated  using  the  definitions  given.  Note  that  m  ie  different  for  the  two  experiments 
when  N  is  not  specified.  A  902  confidence  interval  has  been  used, 

Analyzing  the  results  in  Table  5,  one  readily  draws  the  conclusion  that  x  is  extremely  variable.  Note 
that  a  different  x  must  be  calculated  for  every  case  here.  When  deletion  occurs  for  the  transient  re¬ 
sponses,  far  less  observations  are  available  for  analysis  when  N  is  fixed. and  this  increases  the  vari¬ 
ability  of  x.  When  N  and  the  number  of  observations  deleted  are  fixed,  sf  decreases  as  k  decreases  (m 
increasing)  and  this  Is  as  expected,  It  ia  difficult  to  draw  any  conclusions  about  the  d's  except  that 
the  more  observations  included  In  the  analysis,  the  smaller  the  d's  become.  In  experiment  one,  several 
of  the  confidence  intervals  do  not  contain  the  steady  state  mean.  This  occurs  buesuse  x  is  very  low  and 
d  is  not  large  enough  to  include  the  value  of  the  mean.  Again,  we  cannot  comment  upon  the  coverage  un¬ 
less  numerous  experiments  are  performed.  The  sizes  of  the  d's  are  much  larger  in  Tsble  5  for  a  fixed  N 
than  they  are  for  wither  the  regenerative  method  or  the  method  of  bntdh  means. 
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5.  SEQUENTIAL  PROCEDURES  AND  TIME  SERIES  ANALYSIS 

Tha  length  of  confidence  Intervals  la  a  function  of  the  number  of  observations  collected  and  analyzed,  the 
variability  of  the  random  variable  being  investigated,  and  the  probability  that  the  confidence  interval  con¬ 
tains  the  parameter  being  estimated*  The  three  methods  of  analysis  presented  In  Section  III  required  the 
analyst  to  specify  the  sample  size  prior  to  conducting  the  experiment  and  are  referred  to  as  fixed  sample 
size  procedures.  In  fixed  sample  size  procedures,  the  length  of  the  confidence  interval  is  not  under  dir¬ 
ect  control  of  the  enalyat  because  it  is  determined  by  the  number  of  obaervetlons  fixed  prior  to  running 
the  experiment. 

In  many  studies,  ona  desires  to  fix  the  length  (width)  of  the  confidence  interval*  instead  of  the  sample 
size.  There  are  a  set  of  procedures  to  allow  this  and  they  are  called  sequential  procedures.  These  type 
of  procedures  use  a  "stopping  rula"  to  determine  when  sufficient  observations  have  baan  oollacted  during 
an  experiment  Co  satisfy  the  length  of  the  confidence  interval  desired.  There  are  two  types  of  stopping 
rulest  aboslute  width  and  relative  width.  In  absolute  width  atopping  rules,  the  analyst  specifies  a  con¬ 
stant  (numerical  value)  that  la  the  maximum  width  (length)  uf  the  confidence  interval  desired.  In  rela¬ 
tive  width  atopping  rules,  the  analyst  spsclfias  the  maximum  width  of  the  confidence  interval  desired  as 
some  function  of  the  parameter  being  estimated,  e.g. ,  101  of  the  value  of  the  estimate  of  the  parameter 
being  estimated.  Various  sequential  procedures  have  been  suggested  and  recommended  for  use  in  performing 
steady  state  analysis  in  simulation  (Fishman,  1977,  1978,  Lavenburg,  et  al. ,  1977,  Law  et  al.,  1978,  and 
Fritsker,  et  al.,  1979).  Law  et  al.,  1978,  have  made  a  limited  comparison  of  several  of  the  sequential 
procedures  and  concludes  that  two  of  them  are  batter  than  thu  other  methods  they  tested. 

As  an  alternative  to  obtaining  independent  observation!  to  perform  eteady  etate  analysis  of  simulation  out¬ 
put  data,  time  series  techniques  can  be  used.  Simulation  output  data  that  is  correlated  and  in  eteady 
state  is  a  realization  of  a  wide  sense  stationary  process.  There  are  several  time  aeries  techniques  that 
can  be  used  to  analyze  data  '.nat  come  from  wide  sense  stationary  processes.  These  techniques  analyze  the 
data  either  in  the  time  domain  or  the  frequency  domain.  Techniques  that  use  autocorrelation,  autoregres¬ 
sive,  and  autoregressive-integrated  moving  averages  are  examples  of  time  domain  techniques.  Spectral 
analysis  is  the  major  technique  used  in  the  frequency  domain.  A  large  number  of  observations  (one  long 
run),  knowledge  of  advance  statistics,  and  in  depth  knowledge  In  the  time  series  analysis  technique  to  be 
used  are  required  to  properly  apply  time  series  analysis  techniques  because  they  ere  sensitive  to  proper 
application.  Two  advantages  of  using  time  series  analysis  instead  of  classical  statistical  analysis  are 
the  correlation  structure  of  the  data  is  utilized  in  time  series  analysis  and  the  simulation  user  is  not 
forced  to  obtain  independent  observations. 

The  point  estimator  af  the  steady  state  mean  using  the  time  series  anelysle  is  still  givsn  by  (1),  but  es¬ 
timates  of  the  variances  can  be  obtained  in  a  variety  of  ways  for  each  of  the  various  techniques.  One 
method  of  estimation  for  the  autocorrelation  technique  ie  given  in  Section  II.  ThlB  method  of  estimation 
is  not  considered  a  good  mathod  by  several  investigators  because  tha  p(k)'s  are  correlated,  the  correlation 
estimator  given  has  a  large  variance,  and  some  empirical  evidence  indicate  that,  they  are  bias  on  tha  low 
side  (Duket,  at  al.,  1978  and  Law,  1977).  Discussion  of  various  time  domain  techniques  are  found  in 
Andrews,  R.  w.,  1978,  Box  ,  et  al.,  1970,  Devor,  at  al.,  1972,  Fishman,  1967,  1973,  1978,  Kleijnen,  1974, 
1975,  and  Law,  1979b. 

Spectral  analyBia  converts  data  from  the  time  domain  into  the  frequency  domain  using  eine  and  cosine  waves 
of  different  frequencies  and  amplitudes.  The  sama  information  is  contained  in  the  data  but  different  in¬ 
sights  into  the  behavior  of  the  data  can  be  obtained  by  using  spectral  analysis  as  wall  ss  point  and  Inter¬ 
val  estimataa.  Data  for  spectral  analysis  is  taken  at  fixed  intervals  of  time.  There  are  numerous  ways 
to  obtain  estimates  of  the  parameters  in  spectral  analysis  end  they  must  be  used  with  cere.  There  has  basn 
mixed  reaction  in  using  spectral  analysis  for  analyzing  simulation  output  data  (Duket,  et  al,,  1978, 

Fishman,  1967,  1973,  1978,  Hunt,  1970,  Jenkins,  et  al.,  1968,  and  Law,  1979b). 

6.  SELECTION  AND  COMPARISON  OF  METHODS  FOR  STEADY  STATE  ANALYSIS 

When  a  simulation  analyst  desires  to  obtain  point  end  interval  estimates  of  the  steady  state  mean,  one 
specific  method  of  analysis  must  be  selected.  The  method  selected  will  usually  depend  upon  the  specific 
problem  and  on  the  analyst's  knowledge  of  analysis  techniques.  This  author  recommends  that  analysts  choor.e 
one  of  the  simpler  methods  of  analysis  unless  they  have  knowledge  In  advanced  statistics.  Thus,  most  simu¬ 
lation  analysts  will  select  a  fixed  or  sequential  method  requiring  independent  and  identically  distributed 
observations  instead  of  a  time  series  method.  Unfortunately,  only  limited  quantitative  knowledge  ie  avail- 
able  to  aid  in  this  decision. 

This  author  recommends  simulation  analysts  to  use  either  the  regenerative  method  with  Jackknife  estimators 
or  the  method  of  batch  means  with  a  small  number  of  batches,  say  four  or  five,  for  obtaining  point  and 
interval  estimates  of  the  steady  state  method.  In  general,  the  regenerative  method  should  be  given  prefer¬ 
ence  because  it  is  based  upon  sound  statistical  theory  and  there  is  no  transient  response  tdbe  concerned 
with.  Unfortunately,  in  many,  if  not  moat,  simulations,  the  regenerative  method  cannot  be  applied  because 
the  simulation  model  docs  not  have  any  regenerative  points  (or  the  analyst  cannot  identify  any)  or  the 
length  of  the  cycles  (time  between  regenerative  points)  are  so  large  that  the  computer  coats  ere  prohibi¬ 
tive  in  obtaining  data  on  the  large  number  of  cycles  required.  (Recall  that  the  central  limit  theorem  is 
used  in  developing  the  regenerative  method  which  requires  a  large  number  of  lid  observations.) 

If  the  regenerative  method  cannot  be  used,  then  the  method  of  batch  means  should  be  used.  The  method  of 
batch  means  is  preferred  over  the  method  of  replications  because  (1)  there  is  only  one  transient  response 
to  be  truncated  and  thus  the  analyst  can  be  conservative  and  eliminate  sufficient  observations  to  avoid  a 
bias  point  estimator  and  (ii)  this  approach  has  given  good  results  in  most  empirical  studies  performed  (Law, 
1977)  using  a  small  number  of  batches  vith  a  reasonable  number  of  observations  in  each  batch.  (One 
may  think  ot  the  batches  in  the  method  of  batch  means  as  an  approximation  to  what  is  being  accomplished  in 
the  regenerative  method  in  obtaining  exact  lid  observations  using  cycles.)  The  number  of  observations  in 
each  batch  should  be  sufficiently  large  to  eliminate  correlation  between  batches  and  to  have  the  batch 
means  approach  normality  even  when  the  observations  may  be  far  from  normal. 


In  using  tha  reganaratlve  method  or  the  method  nf  batch  me ana ,  the  enalyst  can  chooaa  to  uaa  the  fixed 
sample  size  methods  described  In  Section  3  or  choose  a  sequential  procedure,  hew,  et  al.,  1978,  recommends 
Fishman  sequential  method  (1977,  1978)  to  be  used  with  the  regenerative  approach  and  the  sequential  method 
of  Lav,  et  al.,  1979d,  to  be  used  with  the  method  of  batch  means.  Law,  et  al.,  1978,  recommendations  were 
based  upon  a  limited  study  they  made  comparing  several  of  the  sequential  procedures.  A  note  of  caution  in 
using  the  fixed  size  methods  is  to  make  sure  a  sufficiently  large  number  of  cycles  era  used  in  regenerative 
method  and  sufficiently  large  number  of  observations  are  used  in  each  batch  of  the  method  of  batch  means 
to  enable  an  accurate  confidence  Interval  to  be  obtained. 

7.  ANALYZING  TERMINATING  SIMULATIONS 

In  the  introduction  we  defined  terminating  simulations  and  stated  we  would  delay  discussing  how  to  obtain 
point  and  interval  estimates  of  means  of  Interest  in  terminating  simulations  until  wa  had  completed  dis¬ 
cussing  steady  state  analysis.  The  reason  for  this  was  that  the  simple  method  used  in  terminating  simula¬ 
tion  is  one  of  the  simple  methods  used  in  steady  state  anelyeie.  The  simple  method  used  to  obtain  point 
and  Interval  estimates  of  means  in  terminating  simulations  is  the  method  of  replication.  Recall  that  in 
terminating  simulation,  tha  results  are  a  function  of  the  initial  conditions  and  the  time  period  of  inter¬ 
est,  Thus  in  performing  the  method  of  replication,  Cha  same  initial  conditions  are  used  in  each  replica¬ 
tion  but  with  a  different  seed  in  each  of  the  random  number  generators  to  obtain  a  different  realization 
for  each  replication.  Each  replication  gives  one  lid  observation  to  be  used  in  the  statistics  discussed 
in  Section  2  and  3  for  obtaining  the  point  and  Interval  ostimates. 

The  observations  of  most  variables  of  lntarest  will  not  bs  normally  distributed  and  thus  a  large  number 
of  replications  will  be  required  in  order  to  usa  the  central  limit  theorem  to  obtain  normality.  This  can 
be  quite  costly  in  computer  time  but  there  is  currsntly  no  other  method  to  develop  confidence  intervals 
(Interval  estimates)  in  terminating  simulations. 

This  method  of  replication  is  a  fixed  sample  size  procedure  if  the  number  of  replications  are  specified 
prior  to  running  the  experiment,  There  are  sequential  procedures  of  both  fixed  end  relative  length  that 
can  be  used  in  terminating  simulations  (Law,  at  al.,  1979a).  In  these  procedures,  replications  continue 
until  the  appropriate  confidence  interval  size  is  obtained. 

8,  CONCLUSIONS 


This  paper  described  in  detail  the  simpler  methods  of  obtaining  point  and  interval  estimates  of  means  in 
terminating  and  steady  state  simulations  and  briefly  dlscussad  tha  other  methods.  It  was  recommended 
that  the  regenerative  method  be  the  first  choice  and  the  method  of  batch  means  be  tha  second  choice  in 
performing  analysis  of  steady  state  simulations.  In  terminating  simulations,  the  only  simple  procedure  is 
the  method  of  replications.  In  almost  all  studies  performed  to  date  to  determine  how  accurate  are  the 
confidence  Intervals  for  estimating  means  in  simulations,  the  site  (length)  of  them  were  too  small.  There¬ 
fore,  a  simulation  anayet  as  well  as  the  decision  maker  using  statistical  estimates  from  simulation  studies 
should  be  cautious  in  how  accurate  are  simulation  results. 

A  case  study  was  included  to  illustrate  the  three  simple  methods  described  in  detail.  Tha  results  of  this 
study  showed  the  variability  in  obtaining  estimates  from  simulations,  One  should  not  draw  any  conclusion 
from  this  case  study  to  be  used  in  other  simulation  investigations.  In  fact,  many  simulations  will  have 
considerably  more  variability  than  this  simulation  model. 

Variance  reduction  techniques  were  not  discussed,  details  of  sequential  procedures  and  time  series  analysis 
techniques  were  not  presented,  nor  were  methods  for  comparison  of  alternatives.  Methods  to  determine  tha 
sample  size  in  the  fixed  sample  size  procedures  were  not  discussed.  To  obtain  sample  sizes,  one  must  per¬ 
form  a  simulation  experiment  to  obtain  point  eetimates  of  u  and  o_,  ,  then  use  theie  estimates  to  determine 

the  sample  size  desired.  See  FritBker,  et  al. ,  1979,  for  details? 

One  must  always  remember  that  statistical  analysis  of  the  output  data  is  only  one  step  in  the  simulation 
methodology.  The  results  of  the  output  analysis  can  be  no  better  than  the  accuracy  of  the  input  data  tnd 
the  validity  of  the  model.  Research  is  continuing  into  statistical  analysis  of  simulation  output  data  and 
the  simulation  analyst  should  follow  these  developments. 
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SUMMARY 

A  definition  of  "What  Is  Simulation"  Is  followed  by  some  classic  experiences  and  knowledges.  Simulation 
Is  widely  used  In  Systems  Analysis  to  understand  problems  In  planning  of  new  weapon  systems.  Here  simulation 
-  another  tool  beside  calculation  and  experimentation  -  serves  for  operational  as  well  as  for  technical 
Investigations.  In  the  field  of  Systems  Technique  by  the  activities  of  "systems  engineering" 

o  alternative,  parametric,  conceptual  predesigns  are  generated 
o  the  technical  feasibility  must  be  Investigated 

o  the  Integration  of  sub-systems  to  a  total  system  must  be  studied 

o  the  relations  between  technical  performances  and  reliability  and 

maintenance  must  be  taken  Into  account 
o  the  efficiency  of  technical  performances  must  be  set  Into  rolatlon 
of  funding  for  R  4  D,  procurement  and  for  operation. 

The  systems  engineer  -  responsible  for  the  prodeslgn  -  has  here  to  handle  with  assumptions  about  15  to 

25  years  In  beforehand  and  the  systems  enqlneer's  tool  for  studying  the  dynamic  behaviour  of  a  system  Is 

called  "simulation". 

Within  the  scope  of  this  essay,  objectives,  areas  of  us®,  possibilities,  limitations  In  the  field  of  simu¬ 
lation  are  mentioned. 

3 

Final  remarks  are  aimed  on  Important,  evolutionary  branches  In  avionics  and  C  and  on  technology  transfer. 

The  paper  concludes  on  the  Importance  of  Intensive  use  of  simulation, 


1.  INTRODUCTION 

1.1.  Definition  of  Simulation 

This  essay  should  start  with  a  classic  definition  on  the  activities  and  areas  of  "Simulation".  For  this  the 
statement  of  Broqkhaus  EnzyklopHdlefQls  used  because  the  author  has  made  the  experience,  to  get  a  well 
accepable  description  In  every  situation.  (See  Fig.  1).  For  digging  a  little  bit  deeper,  It  has  been  tried 
veryoften,  to  create  families  of  standards  like  "hard-ware-simulation"  or  "soft-ware-slmulatlon"  -  however 
with  rather  little  success.  In  practice  different  applications  have  been  adopted,  but  Is  has  been  proven 
right,  that  simulation  Is  characterized  at  all  times  by 

o  obtaining  the  results  of  Investigation 
by  using  a  model 

o  considering  the  timely  passing  of  the  events'. 

In  so  far  the  simulation  Is  differentiated  essentially  fro.m  the  calculation  on  one  side  and  the  experiment 
on  the  other.  Frequently  simulation  and  test  occur  tn  combination  of  course;  for  example  at  fatigue-testing 
of  an  aircraft  structure  -  the  real  structure  and  not  a  model  Is  used  as  specimen  -  the  airloads  are 
simulated. 

3 

For  this  AVP  meeting,  dedicated  to  C  ,  It  should  be  amusing  to  point  at  mixed  types  of  simulations  In  the  light 
of  the  famous  example  from  biology,  where  it  could  be  clarified,  that  the  honey-bees  navigate  by  means  of 
radiation  of  the  sun 

case  1  bee  real  sun  real 

case  2  bee  real  sun  simulated 

case  3  bee  simulated  sun  real 

case  4  bee  simulated  sun  simulated 

According  the  circumstances  -  scientists,  enqlneers,  can  point  their  Interest  at  the  "Inner  loop"  or  the 
"outer  loop"  of  signal  flow  In  a  system  -  types  of  simulation  like  cases  2,  3,  or  4  can  be  applied. 


1.2.  Retrospective  View 

The  push  of  Innovation  in  the  field  of  electronics  has  entered  In  wide  areas  of  our  life  -  perhaps  In  pre¬ 
dominant  cases;  perceived, by  the  human  beings  or  not  Relative  to  the  posslbll Ity/feaslbll Ity ,  performing 
a  simulation,  some  experiences  made  by  the  author  should  be  reported  on,  At  the  end  of  the  fifties  /  the  be¬ 
ginning  of  the  sixties  the  extensive  application  of  simulation  began  for  Invest! eating  flight  mechanics  f.e. 
flying  qualities,  handling  qualities  of  vertlcal-take-off-and-landlng-vehlcles  (VTOL-alrcraft).  f2(J 


The  reproduction/ the  ability  of  transference  of  flight  experiences  with  helicopters  has  been  doubted  and  on 
the  other  side  It  has  been  assumed  too  dangerous  to  start  with  free  flying  tests  and  after  all  pure  calcu¬ 
lations  let  not  discover  the  total  dynamic  behaviour  of  the  vehicle  plus  Its  control  system. 

The  analog  computer  technique  -  at  that  time  the  training  simulators  of  civil  transport  aircraft  as  well 
as  military  fighter  aircraft  based  on  the  analog  computer  -  has  been  used,  to  lay  out  /  to  design  the 
control-  and  steering-system  for  airplanes  and  to  Investigate  flying  qualities  and  to  formulate  pertinent 
criteria.  Large  analog  computer  centres  have  been  established,  but  as  well  the  Investment  In  machinery  as 
also  theoretical  questions  /  Influences  of  accuracy  and  ability  of  reproduction  did  no  longer  allow,  to  In¬ 
vestigate  systems  which  became  more  and  more  complex,  economically  and  technically  correct. 

That  was  the  moment,  digital  computers  have  been  used  for  the  first  time  for  flight  simulations.  Nevertheless 
there  has  been  no  chance  to  fly  a  simulator  In  real  time.  Scientists  and  engineers  came  together  In  meetings, 
to  discuss  possibilities  and  constraints  In  the  application  of  the  digital  computer  and  to  estimate  the  trend 
Into  the  future.  As  an  example  for  such  a  meeting,  the  "Congres  de  1 'Aeronautlque  sur  le  Technique  de  calcul 
analoqique  et  numerlque  en  aeronautlque"  at  LUttich  In  the  year  1963  should  be  mentioned.  L3J 

The  author  worked  In  those  years  1961/62  on  the  dynamic  behaviour  of  components  In  a  VTOL  aircraft  flight 
control  system  (f.e.  hydraulic  cylinder  with  limited  max.  speed  and  with  deflection  limitation).  Me  has 
written  the  program  for  digital  simulation  and  a  digital  computer  IBM  6S0  has  been  used  for  an  Investigation 
of  the  handling  qualities  of  a  flying,  hovering  bedstead. 

All  components  of  the  controlsystem  have  been  modelled,  meanwhile  the  vehicle  has  been  described  only  by 
mass  and  Inertial  moments  (no  aerodynamics).  To  receive  a  result  on  approximate  3  minutes  of  flying  time 
the  computer  (at  those  days)  had  to  run  for  about  5  hours!  the  cycle  time  -  to  Integrate  through  all 
the  differential  equations  -  was  low  and  furthermore  one  had  to  reserve  on  the  computer's  memory  site 
(over  lay). 

In  FI q.  2  some  typical  characteristics  on  digital  computers  of  that  era  in  comparison  to  the  modern  one  are 
shown.  This  may  point  at  the  limitations  In  those  former  days,  which  made  some  racking  of  the  engineer's 
brain  -  and  this  may  point  at  the  matter  of  fact,  that  at  present  there  exist  possibilities,  at 'Which  no 
engineer  formerly  ventured  to  dream. 

The  break-through  -  application  of  the  digital  computer  with  high  computation  /  cycle  speed  and  large 
memory  size  -  happened  by  the  successful 

o  Increase  of  the  performance  In  transistor  function  per  chip 
and  that  together  with  the  price-reduction 
o  treatment  of  numerical  mathematics 

-  nooyl  Inearl  ties 

-  systpms  for  differential  equations. 

» 

The  well-known  trend  In  hard-ware  technology  Is  shown  In  Fig.  3 

It  should  not  be  forqotten,  that  this  Increase  In  over  all  performance  Is  also  characterized  by  the  Improvement 
ofthe  system's  soft-ware.  In  total  the  number  of  Instructions  could  be  Increased  from  lCr  In  the  year  1958 
to  lo"  In  the  year  1978  £4). 

Now  some  limitations  In  the  further  Improvement  of  the  hardware  performances  will  be  Indicated, fSJ 

tact  time  per  transistor  function:  year  1948  Mlkrosecond 

year  1968  Nanosecond 

year  1988  Plkosecond 

but  from  a  simulator  specialist's  point  of  view  It  can  be  stated,  that  the  hardware  has  achieved  an  accept¬ 
able  niveau  with  good  reputation,  meanwhile  emphasis  must  be  pointed  at  the  software.  From  a  simulator 
specialist's  point  of  view,  the  hardware  of  today  fulfill  the  requirements  for  the  basic  requirements  on 
accuracy  and  memory  size  adequately,  although  other  specifications  like  whelght,  volume,  power,  reliability 
can  be  /  must  be  /  will  be  Improved. 

These  steps  In  these  two  decades  showed  to  us: 

o  to  differentiate  the  situation  of  a  user  of  a  centralized 
commercial  computer-facll  1 ty 
(closed  shop) 

from  that  of  a  design  engineer  developing  hardware  end 
software  f.e.  In  avionics  and  CJ  using  simulation 
o  no  longer  to  rely  on  a  q)ven  type  of  a  computer 

o  but  to  understand  the  computer  as  a  system  assembled  from 

hardware  and  software. 

o  In  so  far  not  to  try  to  Increase  the  computer  performances 
by  improving  only  tne  hard„are  efficiency 

and  other  things  more. 

About  10  years  ago  It  has  been  Intended  to  simulate  the  Improved  functions  of  a  future  computer  by  use  of  un 
existing  computer  -  this  Is  past.  In  the  same  way  It  Is  past  to  centralize  all  the  required  computation 
power  as  necessary  In  a  complex  technical  system  like  an  aircraft  Into  a  central  computer,  At  present  we  can 
see  turning  away  from  the  total  Integration.  Recently  for  the  design  of  a  most  modern  aircraft  flight  control 
system  emphasis  Is  layed  at  the  decentralization  of  functions  (primarily  on  account  of  economic  advantage)!/)}. 
As  well  In  the  military  technology  field  as  also  In  operation  with  civil  air  carrlersan  "optimal  structure 
of  the  system"  (system's  architecture)  Ts  aspired;  that  means 


decentralization  of  the  computing  power  with  respect  to  the 
distinct  functions  In  such  a  way  that  the  computing  system 
structure  Is  adequate  for  a  family  of  equipment  (f.e.  a  family 
of  jet  transport  aircraft) 

consideration  of  single,  specific  characteristics  pertinent  to 
a  particular  type  wlthU.  the  family,  In  relation  to  the  functions 
decentral  Izatlon. 

are  many  other  stories  about  history  —  but  only  the  following  remarks  should  be  given: 
simulation  Is  now  used  In  ■••pedal  branches 

today  a  large  number  of  Institutions  rrk  on  fundamentals  for  simulation 

techniques  and  on  application  cf  simulation 

today  a  large  number  of  meetings  occur  on  the  matter  of  simulation 

at  NATO  simulation  and  simulation  results  are  discussed  as  well  In  the  AVP  Panel 

as  In  other  Panels  and  furthermore  In  many  NATO  groups  (AC,..)  .  , 

the  number  of  publications  on  simulation  has  been  Increased  rapidly  (7j  to£l8J  . 


At  the  end  of  this  retrospective  view  It  can  be  stated,  the  digital  computer  in  use  for  simulation  Is 
an  exeptlonal  tool  for  the  engineer  /  scientist. 


now 


1.3. 


Contemplations  on  systems  In  avionics  and  C 


This  AGARD  meeting  Is  pointed  at  the  application  of  simulation  in  avionics  and  command  a  control  and  In 
communication.  Fig.  4  shows  an  example  on  air-defense  Implying  all  the  detailed  use  of  avionics  and  C3. 

This  Fig,  4  should  be  representative  for  a  number  of  functions,  activities,  components  etc.  by  listing  up 
(as  examples)  the  following  Items 

o  command  &  contnol 
o  avionics 

o  outer  loop 

o  Inner  loop 

o  computer:  hardware  /  software 
o  data  transmission 

o  traffic  control 

o  communication 
o  Identification 
o  a/c  flight  control  systems 
□  navigation 

o  weapon  delivery 

o  counter  measure 

o  others 

It  Is  the  aim  of  this  meeting,  to  discuss  on  simulation  applied  In  the  most  different  branches  end  under 
most  different  situations  /  questions  /  alms  of  Investigations. 


2.  AREAS  OF  USE  OF  SIMULATION  /  SIMULATOR 

2.1.  Survey 

The  simulation  Is  used  as  a  scientifically  established  tool  beside  the  experiment  and  beside  the  calculation. 
This  Is  shown  In  Fig.  5. 

Simulation  Is  applied  for 
o  technical  tasks 
o  operational  tasks 

(In  the  case  of  military  questions) 
o  other. 

The  dotted  line  In  the  left-hand-side  of  the  figure  should  express,  that  simulations  and  tests  frequently  go 
together  In  combination. 

As  examples  for  ecological  /  economical  investigations,  the  models  of  Forrester  and  Meadow  and  some  treatises 
of  other  persons  are  normally  mentioned  £193  to  [i lj  . 

By  Fig.  6  It  should  be  expressed  that  simulation  Is  applied  In  different  activities,  following  one  each  other 
In  sequences,  called  research,  planning  and  assessment,  development  and  testing,  training.  It  must  be  remarked 
that  different  simulation  tasks  demand  for  different  simulator  Installations.  This  depends  on  the  matter  of 
fact,  that  simulations  are  always  approximations  -  namely  because  of  technological  and  economical  reasons. 
Therefore  In  every  case  the  correlation  of  simulation  to  real  world  must  be  proved  adequately.  This  Is  also 
pertinent  to  the  pure  mathematical  simulation,  which  Is  shown  In  Fig.  7  In  opposite  to  the  simulation  with 
''component  In  the  loop"  or  extremly  “mar  In  the  loop".  By  this,  the  requirements  for  a  real  time  simulation 
and  for  generating  of  the  environmental  cues  are  pointed  at.  It  Is  evident,  that  the  highest  demands  must  be 
engaged  In  the  case  of  simulation  with  “man  In  the  loop". 


2.2.  Simulation  In  the  field  of  research 
Simulation  Is  widely  used  In  the  fields  of  research. 

As  oi:o  example,  the  simulator  Installation  for  Investigating  fundamentals  on  "computer  generated  images" 
can  U  mentioned.  The  aim  of  such  a  task  Is  to  Investigate  how  much  accuracy  1$  required  -  and  In  conse¬ 
quence  how  much  money  must  be  spent  -  for  providing  acceptable  environmental  cues  to  a  pilot  or  In  other 
words  where  Is.  the  lower  limit  for  slmpllflcatlng  of  such  a  technical  device  just  still  producing  adequate/ 
acceptable  cues  to  the  pilot. 

Another  example  Is  the  use  of  a  flight-simulator  for  Investigating  handling  qualities  criteria. 

As  a  third  example,  In  Fig,  8  a  movable  cabin  Is  shown.  It  is  used  In  research  on  environmental  cues  to  a 
pilot.  Particularly  Interdependencies  between  acceleration  cues  and  visual  cues  are  Investigated.  A  typical 
question  Is,  to  which  degree  an  acceleration  can  be  supressed  or  neglected  In  presence  of  visual  cues  or  In 
other  words  by  which  degree  acceleration  cues  can  be  replaced  by  vlsiual  cues. 

2.3.  Simulation  for  planning,  pre-design,  assessment  and 
feaslbl 1 Ity-transparency 

In  modern  weapon  systems  we  can  see  the  Increase  In  technological  complexity.  This  Is  followed  by  a  high 
risk  In  development,  by  higher  cost  for  development  and  other  consequences.  This  demands  already  at  the  be¬ 
ginning  of  the  planning  for  new  technical  future  systems  the  more  Intensified  use  of  systems-englneerlng 
activities.  As  an  example  for  applying  simulation  In  the  early  planning  phase  the  "Dual -Flight-Simulator" 
of  IABG,  Germany,  Is  shown  In  Fig,  9.  This  Installation  Is  described  in  detail  In  several  publications,  f.e. 

In  LZ2]  .  With  respect  to  the  state  of  art  in  technology  and  with  respect  to  the  application  this  Instrument 
Is  comparable  to  the  "Manned  Aircraft  Combat  Simulator  (MACS)"  of  McDonnel  Douglas  and  to  the  "Dual  maneuvering 
Simulator"  at  NASA  Langley.  See  also  [ 23 7  for  a  more  general  explanation. 

Already  at  the  "Congres  sur  le  Technique  de  calcul.."  in  the  year  1963  the  author  has  pointed  at  the  necessity 
to  Investigate  the  dynamic  behaviour  of  a  system  by  the  use  of  simulation  already  In  a  pre-design-status  that 
means  In  a  technical  feasibility  study  before  the  beginning  of  the  real  development.  In  £24j ,  the  author  ex¬ 
plained,  that  Initial  results  and  experiences  on  the  Interdependencies  and  the  collective  actions  of  all  sub¬ 
systems  (f.e.:  basic  aircraft,  control  system  with  all  components,  flying  quality  criteria,  feasibility, 
Integrabillty,  efficiency  and  reliability),  simulated  on  the  basis  of  the  first  lay-out-design,  must  be  re¬ 
transferred  to  the  project/deslqn  bureau,  thus  Improving  the  first  approximated  design. 

2.4.  Simulation  In  the  development  phase 

It  Is  normal  practice  for  the  engineer,  responsible  for  the  development  of  a  new  device,  to  perform  designs, 
constructions  and  computations.'  Studying  tne  dynamic  behaviour  he  uses  the  simulation.  Starting  with  a  pure 
mathematical  simulation  for  specifying  the  technical  requirements  on  the  new  component,  the  mathematical 
mode’s  will  be  replaced  step  by  step  by  the  real  -  brand  new  built  -  component  such  realizing  the  so-called 
"Iron  bird".  In  Fig.  10  the  Iron  bird  of  the  MRCA  aircraft  -  the  flight  control  test  rig  -  Is  shown. 

In  the  field  of  the  software  also  simulation  Is  used  as  a  tool  for  developing  and  optimizing  software.  Fig.  11 
gives  some  explanation  on  the  structure  of  such  a  type  of  simulation, 

2.5.  Simulation  during  testing 

Every  technical  development  Is  finished  by  an  acceptance  test.  Also  In  these  cases  -  certification  of  re¬ 
quired  performances  and  particularly  safe  operation  -  simulation  Is  used.  It  can  be  said,  that  In  many  cases 
acceptance  tests  can  be  performed  only  In  connection  with  simulation.  Typical  examples  are  shown  In  Fig.  12 
(testing  the  avionic  equipment  of  an  aircraft)  and  In  Fig  13  (fatigue  testing  the  main  structure  of  a  civil 
transport  Jet  aircraft). 

2.6.  The  Training  Simulator 

The  training  simulator  Is  a  well  known  Instrument,  Even  civilian  people  /  travellers  have  heard  about  simu¬ 
lators  for  civil  transport  jets  used  by  the  captains,  As  an  example  In  military  use  Fig.  14  shows  the 
"cockpit  operational  Fighter  Trainer"  for  the  A/C  F-4  as  In  service  with  the  German  Airforce.  That  Is  a 
typical  device  for  procedure  training.  Other  types  of  procedure  training  simulators  are 

o  gunnery  simulator 
o  guided  missile  controlling  simulator 

o  battle  tank  driving  simulator 

o  submarine  controlling  simulator, 


3. 


ACTIVITIES  PRIOR  TO  WEAPON  SYSTEMS  DEVELOPMENT 


3.1.  Pioblems 

Frequently  there  arise  the  questions  -  perhaps  at  the  end  of  the  development  of  equipment  or  during  the 
operation  in  service  -  whether  the  original  requirements  have  been  met  by  the  now  completed  technical 
system  and  whether  the  actual  cost  corresponds  with  the  planned  expenditure.  In  a  reverse  case  another 
question  asks  for  the  reasons  of  discrepancies,  Those  questions  are  terms  of  the  problems,  constraints 
and  influences  In  the  weapon  system's  acquisition  process  of  modern,  future,  complex,  technical  systems 
like  weapon  systems.  It  Is  the  aim  of  the  systems  planning  process  to  balance  the  technological  Improvement 
In  relation  to  time  (operational  availability)  for  meeting  the  military  /  tactical  requirements,  the  risk 
(primary  Increase  In  cost)  and  the  1  Ife-cycl e-coot.  (See  also  C5J  ). 

In  a  simplified  style,  Fig.  15  explains  the  steps  from  the  frlst  pre-design  to  the  real  end  product.  At  the 
beginning  there  will  be  stated  the  requirements,  leading  to  the  first  pre-design.  Then  the  subsystems  and 
components  are  designed,  calculated  and  constructed  separately.  Finally  these  subsystems  are  integrated  and 
all  people  -  envolved  In  these  development  stages  -  now  hope,  that  the  now  completed  prototype  will 
work  as  specified  at  the  beginning.  Experienced  engineers  detect  immediately,  that  the  simplifying  assumption, 
to  treat  the  subsystems  and  components  as  Independent  from  one  to  each  other,  can  and  will  lead  to  the  most 
unpleasant  difficulties. 

Fig.  15  gives  an  additional  Information  on  the  time  frame  necessary  from  the  formulating  the  requirements  till 
the  completion  of  a  development  by  qualification  test  in  the  case  of  a  modern  complex  weapon  system.  In 
Fig.  16  this  life-cycle  Is  shown,  demonstrating  that  today  the  planning  phase  endures  about  5  years,  the 
development  about  10  years  meanwhile  the  operational  use  In  service  will  cover  about  20  years. 

Fig.  17  should  point  at  different  ways  to  obtain  systems  with  different  total  11 fe-cycl e-cost,  but  mentioning 

a)  the  problems  of  the  existence  of  different  budget  titles 

for  RAD,  development  and  for  operation  (problem  of  follow-on  cost) 

b)  emphasis  on  more  detailed  activities  in  the  forefield  of  the  real 
development,  for  better  estimating  the  life-cycle-cost  in  the  situation 
of  early  planning  and  for  better  support  on  the  decision-makers,  to 
Interpret  the  total  budgeting  In  relation  to  the  weapon  system's  effectiveness. 

It  seems  to  be  necessary  to  look  at  this  situation  also  from  another  point  of  view.  It  Is  a  matter  of  fact, 
that  higher  tactical  /  operational  requirements  in  accordance  with  more  sophisticated  technology  -  to  meet 
the  Initial  requirements  -  result  In  higher  development  cost  and  higher  single  unit  prices.  Here  the 
question  must  be  discussed,  whether  a  reduction  of  the  number  of  units  procured  (perhaps  as  a  consequence  of 
a  unforeseen  raising  of  the  price)  can  result  In  a  decrease  of  the  over  all  defense  capability.  This  would 
mean,  In  spite  of  the  Improved  performances  of  a  weapon  system,  not  to  lead  automatically  to  better  defense 
capability.  It  is  the  quantity,  that  Influences  our  efforts. 

For  better  understanding  these  circumstances,  It  seems  to  be  favourable,  to  Investigate  these  situations  under 
all  constraints  already  In  the  forefield  of  the  development.  These  experiences  lead  to  thg  more  strictly 
sequenced  process  of  planning.  The  situation  and  Interdependencies,  the  sequences  arid  the  instruments 
solving  the  task  have  been  described  very  pregnant  already  In  1970  by  WAHL  . 

3.2.  Systems  analysis 

For  optimal  sequencing  and  better  manaaing  the  planning  of  development  Itself  a  particular  relevant  regulation 
became  operational  In  Germany  In  1972.  This  regulation  -  called  "Entstehungs-  und  Beschaffungsgang  von 
Wehrmaterlal  (EBMat)"  -  orders  some  particular  activities  before  the  beglnnlnq  of  the  development.  It  Is’ 
directed  to  the  same  goal  like  the  "US  weapons  acquisition  process",  even  if  there  are  some  remarkable 
differences.  In  the  EBMat  It,  is  stated,  that  in  thB  first  phase  so  called  "study  groups"  should  define 
"tactical  requirement-papers" .  These  study  groups  will  be  supported  by  operational  analyses  and  by  technical 
feasibility  studies.  )j?7j 

System  analyses  are  applied  to  Investigate 

o  the  technical  feasibility 

o  the  operational  effectiveness 

o  the  budgeting  possibilities  /  necessities. 

A  definition  on  Systems  Analysis  is  presented  In  Fig.  20,  describing  an  Iterative  process  starting  with  a 
first  approximation,  For  this,  a  first  technical  pre-design  as  an  'Idea  of  solution"  must  be  created.  In 
most  cases,  It  Is  benefltlal,  to  provide  for  a  spectrum  of  alternative,  parametric,  conceptual  pre-designs 
of  future  weapon  systems,  followed  by  operational  Investigations  ( OR-studl es )  to  filter  out  those  designs, 
that  are  out  of  Interest  from  an  operational  point  of  view.  The  remaining  technical  design  can  now  be 
Improved  and  they  will  be  used  In  the  next  step  of  the  Iterative  process.  |_28J 

3.3.  System's  Engineering  Activities 

Today  all  extensive,  large  technical  projects  will  be  accompanied  by  what  is  called  "systems  technique". 

It  Is  now  practice  -  at  least  In  Germany  -  to  call  the  first  activities  In  this  technical  field 
"systems  engineering",  this  means  to  produce  a  first  pre-design:  (see  Fig.  22). 

The  goal  aspired  Is  the  conceptual  system  pre-design.  Significant  terms  are 
o  design  principles 
o  sensitivity 

o  compatibility  /  systems  Integration. 


By  the  technical  design  as  a  connecting  link 

a)  performances  can  be  calculated 

attention  to  -  reliability  and  vulnerability 

-  maintenance  /  maintainability 

b)  cost-estimation  can  be  made 
-  RID 

Procurement  (single  unit). 

Fig.  22  demonstrates  the  sequences  In  activities  for  producing  a  new  weapon  system  starting  with  research 
ana  finishing  with  bringing  this  equipment  Into  operation. 

System  engineering  activities  In  Germany  are  performed  In  the  Industry  firms  within  the  Future  Tachnologle 
Programs . 

Furthermore  system  engineer  studies  are  treated  at  the  system-engineering  groups  (WT)  at  IABG  directly  for 
the  German  MoD.  The  aim  of  such  studies  Is  defined  by: 

a)  for  the  Armament  Offices: 

o  technical  studies  for  investigating  the  technical 
feasibility  (plus  cost-estimation)  durlnq  the  early 
planning  phase 

o  neutral,  critical  assessment  of  proposals  from  Industrial 
competitions  on  new  weapon  systems 

b)  for  OR-actl vl ties : 

o  generation  of  technical  data  on  description  on  function/ 

mechanism  of  weapon  systems  as  Input  data  for  operational  studies. 

The  most  Important  problem-areas  from  the  system-engineering  point  of  view  are: 

o  the  forecasting  on  the  progress  of  scientific  /  technological 
basic  parameters  (see  Fig.  23) 

o  the  realization  and  the  stipulation  of  the  quantity  performances, 

reliability  and  maintenances,  which  are  exchangable  to  some  amount  (see  Fig.  24) 
o  the  Integratlblllty  of  the  components  to  the  total  system 
(compatibility  and  sensitivity). 

To  discover  -  already  In  the  presence  -  risk-components  and  problematic  technical  Interdependencies  and 
sensitivities,  which  could  emerge  at  the  production  of  the  frlst  prototype,  the  pre-design  engineer  has  to 
assume  the  state  of  the  art  In  technology  of  abuut  20  years  In  beforehand.  Such  a  forecasting  Is  affected 
with  some  amount  of  uncertainty  and  the  problems  are  wellknown  If  two  trend  extrapolations  ore  In  contradiction 
(Fig.  23).  Surely  such  a  case  Indicates  a  risk  situation. 

Fig.  24  points  at  the  necessity,  that  the  technical  performances  must  be  produced  In  accordance  with  adequate 
reliability  and  In  relation  to  a  well  described  maintenance  concept.  Distress  make  all  those  components  / 
systems,  of  which  the  performance  Is  forced  with  a  debit  of  reliability  (penalty)  on  the  other  hand.  Also 
there  will  be  some  trouble  with  systems  In  the  operational  phase,  If  the  maintenance  concept  Is  not  well  con¬ 
sidered  (additional  cost  for  maintenance). 

For  being  effective,  for  Investigating  sensitivities  £293  of  basic  scientific-technical  parameters  within  the 
Integrated  systems,  for  understanding  the  feasibility  and  for  being  able  to  describe  dynamics  (all  this  In 
the  early  phases  of  planning  a  weapon  system)  there  are  two  remarkable  methods  In  use  with  the  engineer 

o  the  computerized  parametric  design  [loj 

o  the  simulator. 

These  engineering  tools  have  been  used  highly  successful. 

3.4.  The  Future  Technology  Programs 

The  Future  Technology  Programs  are  the  tool  /  the  method  /  the  way  for  generating  know-how  for  the  future. 

These  programs  for  and  on  behalf  of  the  Armament  Division  of  GMoD  are  well  described  at  other  occasions  and 
In  particular  papers  [ 31 ]  and  £)32j  , 

Thu  Future  Technology  Programs  are  already  mentioned  In  Fig.  22  (ZT-Programme  und  KE-Programmel ,  where  they 
are  described  as  beginning  In  the  forefield  of  the  activities  of  development  planning.  They  give  emphasis 
to  critical  future  components,  provide  for  advanced  methods  and  technology,  are  aimed  to  the  investigation 
of  the  sensitivity  of  Interdependencies  of  components  working  together  In  a  system  and  provi.de  for  conceptual 
predesign. 

Fig.  25  gives  an  overview  on  the  Future  Technology  Programs  of  the  GMoD,  Studies,  Investigations,  experiments 
and  calculations  and  simulation  under  the  notation  "Future  Technology  Programs"  are  mainly  performed  In 
potential  Industry  firms  for  and  on  behalf  of  the  Armament  Division  of  the  GMoD. 

In  particular  In  Flo.  25  the  pronram  for  aero-space-technology  (ZT-Luft)  Is  described  In  a  little  more  detail. 
There  are  working  groups  for  methods  and  components  and  subsystems,  while  working  group  1  Is  responsible  for 
proposals  on  pre-designs  based  on  conceptual  topics. 


3.5.  Simulation  as  a  tool  of  the  systems  engineer 

Within  the  scope  of  the  Future  Technology  Program  and  the  systems  engineering  activities,  numerous  and  ex¬ 
tensive  simulations  of  all  types  are  performed  In  Industry  firms,  research  laboratories  and  other  Institutions 

For  the  use  on  the  governmental  side,  the  simulation  centre  (WTS)  at  IABG  has  been  established  -  starting 
In  1969  -  for  and  on  behalf  of  the  German  Ministry  of  Defense  fi3j  .  The  essential  feature  of  this 
simulator  centre  -  shown  In  Fig.  26  -  Is  Its  flexibility  and  applicability  for  technical  systems  that 
are  In  planning  for  the  three  single  forces  army,  navy  and  airforce.  The  main  parts  of  It  are 

o  the  computer  capacity  in  the  middle  of  the  building 

o  four  experimental  fields  (at  present  2  fields  are  used  for  the  Dual  Flight  Simulator) 

o  a  mechanical  workshop 

o  an  electronics  laboratory  and  manufacturing  capability 
o  a  particular  room  for  anthropotechnical  experiments. 

It  should  be  mentioned  as  a  matter  of  fact,  that  this  simulator  centre  can  (by  order  of  the  German  MoD)  work 
In  cooperation  with  the  Industry  If  necessary  In  extensive  projects  -  and  that  has  been  done  together  with 
governmental  offices  /  agencies,  Industry  firms  and  research  Institutes. 

Some  remarks  on  the  configuration  of  the  computer  capacity  could  be  of  Interest  (see  Fig.  27).  With  respect 
to  the  flexibility  (efficiency)  and  adaptability 

o  this  computation  capacity  Is  not  coupled  to  another  computer  centre 
o  a  particular  system's  software  Is  used 

o  the  concept  of  Interconnecting  or  splitting  the  computer  capacities  Is  fully  applied. 

This  concept  has  proved  excellent. 

3.6 .  Limitations  /  Constraints 

After  so  many  remarks  on  the  possibilities  and  the  advantages  of  simulation  It  Is  necessary  also  to  point  at 
the  limitations  accompanlng  the  simulation.  Due  to  economical  efficiency  It  must  be  aspired  to  run  the  most 
simple  simulation.  Alone  the  requirement  for  good  correlation  of  simulator  results  to  the  real  world  forces 
us  to  use  a  more  sophisticated  type  of  simulation.  Therefore  some  emphasis  must  be  laid  to  find  out  this 
optimal  type  of  simulation,  which  produces  adequate  results  and  which  Is  at  the  same  time  economical 
Justifiable.  The  Increasing  complexity  of  the  weapon  systems,  that  are  Investigated  by  simulation,  as  well 
thfi  situation,  that  all  the  subsystems  are  In  most  oases  no  longer  Independent  from  each  other  (I),  demand 
also  more  complex,  more  sophisticated  simulations  and  simulators. 

For  example  hlqhest  degree  of  attention  must  be  directed  on  the  Imitation  /  modelling  of  the  environmental 
cues,  If  the  simulator  Is  controlled  by  a  human  being.  That  Is  the  task  of  a  large  number  of  scientists  and 
engineers  (In  technique,  ergonomics,  physiologies  and  others)  to  Investigate  technical  possibilities  /  devices 
to  achieve  these  requirements.  £34j 


4.  USE  OF  SIMULATORS 
(national  facilities) 

Simulation  Is  a  quite  normally  used  tool  at  all  steps  In  planning  and  producing  a  modern  weapon  system,  It  Is 
applied  at  all  Institutions  Involved  In  this  work.  Therefore  In  Fig.  28  the  author  tried  to  collect  a  survey 
on  those  Institutions  and  the  aim  of  the  simulations,  This  table  Is  arranged  In  the  different  fields  of 
activities.  This  table  demonstrates,  that  slmuU-.clon  can  be  seen  In  use  widespread  and  therefore  widespread 
experiences  can  be  met. 

5.  IMPORTANT  BRANCHES  IN  AVIONICS  AND  C3 

On  the  basis  of  experience  with  modern  weapon  systems  and  with  pre-design-studies  of  future  equipment,  some 
remarks  should  be  made  on  Important  branches  which  are  In  relation  to  this  AVP  meeting  or  to  the  Avionic 
Panel  generally. 

In  Fig.  29  such  fields  of  Interests  are  listed  up,  which  can  Itself  experience  an  Improvement  of  the  techno¬ 
logy  by  the  pres  of  innovation  In  electronics.  It  Is  hoped,  that  these  applications  will  be  transferred  from 
an  experimental  status  Into  successful  use. 

It  Is  absolutely  sure,  that  the  Improvement  of  the  performances  In  those  branches  will  produce  a  contribution 
to  the  Improvement  of  weapon  systems  or  It  will  permit  to  create  total  new  types  of  weapon  systems  and  /  on 
it  will  enable  for  other  tactics. 

As  well  It  Is  sure,  that  the  successful  carrying  ahead  of  these  technologies  will  occur  by  extensive  use  of 
simulation.  , 


6.  ON  THE  TECHNOLOGY  TRANSFER 

/ 

It  must  be  mentioned,  that  there  Is  no  possibility  to  describe  here  all  the  branches,  types  and  alms  for 
which  simulation  Is  applied. 

Therefore  It  must  not  be  listed  up  here,  from  which  technology  branch  n  know-how  transfer  can  be  provided 
Into  another. 


But  from  the  experiences  of  the  author,  the  remarks  should  be  derived  how  much  the  work  In  simulation  brings 
together  the  specialists  of  different  branches.  The  total  field  of  simulation  Implies  the  matter  of  fact, 
that  different  experiences  Impact  one  each  other,  that  Interdisciplinary  kick-off  will  be  generated  and  that 
this  transferred  know-how  will  spread  out  In  different  directions. 

Already  by  this  Indirect  manner  -  because  of  discussing  how  to  perform  simulation  -  an  exceptional  amount 
on  technology  and  know-how  transfer  Is  guaranteed  I 


7.  CONCLUSIONS 

Occasionally  there  Is  the  question  asked  to  which  degree  simulation  is  used  In  a  correct  way  and  In  sufficient 

extent  (In  the  steps:  research,  planning  and  assessment,  development  and  training). 

The  experiences  from  the  past  and  the  current  activities  allow  for  the  following  statements  (from  a  national 

point  of  view) 

a)  Simulations  will  be  normally  performed  In  a  technological  most  modern  form  because  the  specialists 
are  steadily  working  on  the  relevant  fundamentals  and  simulations  are  normally  performed  In  explicable 
correlation  to  the  real  world,  because  every  well-reputed  simulation  today  is  accompanied  by  the 
Interpretation  of  the  correlative  situation. 

b)  With  respect  to  the  budgetary  possibilities  It  can  be  said,  that  the  different  types  of  simulation 
In  research,  planning  and  assessment,  development  and. training  are  performed  correctly  and  are  used 
sufficiently. 

With  some  statements  In  Fig.  30  this  essay  will  be  completed.  ' 
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Collective 

for  description  and  for  imitating 

physical,  technological,  biological,  psychological  or  economical 
processes  or  systems 
by  mathematical  or  physical  models 
whereby  the  investigation  of  the  model 

is  easier,  cheaper  or  less  dangerous  as  the  original  real  piece 
and 

whereby  the  results  admit  conclusions  on  the  nature  characteristics 
of  the  original  real  piece 
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Fig,  1  Simulation  -  a  definition 


Year  1960 


f.e.  IBM  650 


~5-103 


~  800  000  DM 
FORTRAN  IV 


Year  1979 


(f.e.  IBM  370  series) 
f.e  IBM  4341 

-106 

-4.106  (£  4194  304  byte) 
-  600  DM 

o  High  Order  Language 
o  CSSC 

o  Advanced  continuous 
simulation  language 
(ACSL) 


Fig, 2  Historical  comparison  (some  characteristics) 


r<r*«rp 


Fig.5  Simulation  -  another  method  beside  "test”  and  “calculation" 
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Fig, 7  Simulation  -  u  sort  of  classification 
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Fig  8  Simulation  in  the  field  of  research 


mo  TEST  FACILITY 
Heal-Time 


several 

years 


V 


Question:  will  the  new  developed  system  meet  all  the  requirements  above? 
if  no,  what  influences  cause  the  deviations  ? 

l  ’ 

Fig,  1 5  The  steps  of  developments  a  simplified  version 


Fig.  16  Life  cycle  of  one  weapon  system’s  generation 
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Fig.  17  Life  cycle  cost 
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A)  Performance  Number 

of  the  single  weapon  -  system  unit 

o  performances 
o  effectiveness 
o  single  unit  price 
o  cost  effectiveness 


B)  Defense  capability 

o  weapon  systems  in  combination 
o  quantity  per  every  typ 


o  tactics 


o  total  budget 

Fig,  I  ft  Objectives  of  the  planning  process  different  criteria 
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o  alternative,  parametric  predesigns  of 
future  weapon  systems  , 

o  technical  feasibility 


o  systems  integration /computibility 


o  sensitivity  of  technical  parameters 


Fig.  1 9  The  Instruments  for  planning  support 


systems  analysis 

is  a  heuristic  method 

by  which  components  -  still  unknown  at  the  beginning  of  the 
investigation- interdependencies  and  the  behaviour  of  a  system 
are  determined  in  that  way  of  a  successive  approach. 

It  is  a  strategy  of  determination  -  step  by  step  -  of  systems 
which  shall  be  explained  or  designed 
whertby  the  interdependencies  between  the  subsystems 
are  taken  into  account 

already  at  the  beginning  of  the  investigation 


after  C283 


Fig. 20  Systems  analysis  a  definition 
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Fig. 21  Systems  engineering  the  conceptual  system  design  as  connecting  link  between 
performunce/reliability/maintainubility  and  costing 
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Fig, 22  The  sequences  of  activities  for  providing  a  weapon  system 
(from  research  to  the  final  product) 
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Fig, 23  The  problem  in  forecasting  the  trend  of  a 
scienllfic/physical/technologlcal  parameter 
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Fig. 24  Interrelationship  possibility  of  substitution  between 
these  three  quantities 
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Fig, 25  The  future  technology  programs  for  and  on  behalf  of  the  G  MoD 
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Fig. 26  The  simulator  centre  of  IABG  established  for  FHCI  Mol) 
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Configuration  of  a  computer  specialized  for  simulation 
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Fig. 28  Uso  of  simulation/simulators  national  capabilities  and  application 
(examples;  not  complete) 

o  pattern  recognition 

o  sensor  performance 

o  data  processing 
a  resistance  to  counter  measures 
o  artificial  Intelligence 

Fig. 29  Important,  evolutionary  branches  in  avionics  and  C3 


o  simulation  is  world -wide  proofed  and  accepted 

o  simulation  is  widely  used  in  science  and  engineering 

o  the  degree  of  effectiveness  by  use  of  simulation  is  high 

o  cost -effectiveness  in  relation  to  the  project  investigated  is 
normally  high 

o  in  several  cases  simulation  is  absolutely  the  one  and  only 
instrument  to  provide  for  investigation  results 

o  simulation  is  technically  used  in  most  modern  matter 

o  nevertheless  simulation  must  be  in  adequate  correlation  to 
real  world 

o  this  demands  for  a  high  degree  of  simulation  technique 

0  the  application  of  simulation  will  /  must  be  improved  in  future; 
simulation  tasks  will  he  more  complex 

o  therefore  budgetary  conditions  must  be  improved 


Fig, 30  Conclusions 


REPRESENTING  HUMAN  THOUGHT  AND  RESPONSE 
IN 

MILITARY  CONFLICT  SIMULATION  MODELS 


Dannie  K,  Leedoto 
Taotioal  Systems  Division 
Assistant  Chitf  of  Staff,  Stud is s  and  Analysas 
Headquarters,  Unitad  Statas  Air  Poroa 


Abatraot 


Tha  analysis  of  command  and  oontrol  ayataa  utility  raquiras  an  undaratanding  of  tha  hwan  component  in 
suoh  systans.  This  is  baaauaa  command  and  aontrol  systems  aarva  to  support  various  taetioal  daolalon 
prooassas,  Rasaaroh  findings  from  oognltiva  aolanoa  havs  raoantly  suggaatad  various  thaorias  oonoarnlng 
dsoision  proosasss  whioh  nay  ba  of  usa  to  tha  davalopars  of  oonfllot  simulation  modsls  uaad  in  oosaand 
and  oontrol  analysis.  Two  approaohaa  bo  raprasantlng  daoislon  prooassas  in  sinulatlon  aodals  ara  tha 
usa  of  human  gamers  and  tha  usa  of  oonputar  soianoa  daoislon  aodals.  Ona  oathod  for  axploltlng  tha 
advsntagas  of  aaoh  sinulatlon  approaoh  is  tha  dsvalopnant  of  a  ooonand  and  oontrol  taatbad.  Suoh  a 
tastbad  aould  usa  both  human  ganars  and  oonputar  soianoa  daoiaion  aodals  in  an  ltaratlva  fashion  to 
avolva  a  battar  undaratanding  of  tha  htman  aonponant  in  oooaand  and  oontrol. 


Introduotlon 


This  papar  daals  with  the  subjaot  of  oonfllot  sinulatlon  aodals  and  tha  repraaantabion  of  human  thought 
and  rasponaa  in  suoh  nodal  a.  Tha  ideas  presented  in  this  papar  relate  bo  tha  uoaellng  of  oonfllot 
situations  from  single  aombat  unit  level  up  through  theater  foroa  level.  In  particular,  tha  author 
foouaes  upon  tha  usa  of  suoh  aodals  for  assessing  tha  utility  of  taotioal  oonmand  and  oontrol  (C2) 
systans, 

Tha  author  first  provides  a  disoussion  of  why  explicit  representation  of  human  decision  prooassas  is 
important  in  oonfllot  simulation  modala  used  for  C2  systems  utility  analyses.  Next,  tha  author 
illustrates  various  daolsion  thaorias  and  oonoapta  from  oognltiva  soianoa  and  behavioral  rasaaroh. 
While  nob  providing  a  complete  description  of  how  to  represent  daoislon  processes,  this  disoussion 
suggests  important  aspeats  of  decisionmaking  whioh  should  be  of  interest  to  modal  developers. 

Citing  illustrations  from  two  different  USAF  simulation  efforts,  the  author  presents  and  oontreste  two 
epproaohea  to  raprasantlng  daoislon  prootasea  in  oonfllot  simulation  models.  The  two  spprosohas  ara 
summarized  as  follows) 

Utilize  human  gamers  to  simulate  ooramander/steff  dsoision  processes  vis  man-maohlna 
interfaces  with  s  computer-driven  oonfllot  simulation  model. 

Utilize  rule-based  production  systems  and  other  knowledge  engineering  techniques  to 
directly  simulate  limited  aapeoto  of  commander/' atarr  deoision  prooesaas  within  the 
oonrilct  simulation  model. 

Finally,  the  author  suggaata  the  need  to  combine  both  deoision  modeling  approaches  into  an  axparimental 
testbed.  Such  a  taatbad  oould  extend  oognltiva  researoh  into  e  reelistio,  applied  environment  and 
provide  a  means  for  studying  information  flow  and  deolslonmaking  in  taotioal  C2  systems, 


Performance  Measures  Versus  Utility  Measures  of  C2  Systems 

At  tha  outset  of  this  disoussion,  It  is  importsnt  to  establish  some  rationale  for  the  interest  in  human 
deoision  proesases.  To  do  this,  it  is  further  necessary  to  draw  i  dlstinotion  between  two  output 
measures  of  inbareit  in  moat  analysas  of  tsoticsl  C2  systems.  These  meesurea  are  defined  hers,  as 
follows ! 

Performance  Measure  -  a  specific  measure  of  the  C2  eystem's  capability  to  perform 
Its  own  internal  activities,  without  rsgsrd  to  ths  coneequenoee  of  those  activities. 

For  example,  a  performance  measure  of  a  C2  system  might  be  defined  as  "mssaags 
transmittal  rata",  "data  storage  capacity",  or  "display  update  fraquenoy" . 

Utility  Measure  -  a  speolflo  measure  of  the  C2  system's  contribution  to  the  total 
effectiveness  of  the  associated  combat  fsroe.  For  example ,  a  utility  measure  might 
be  defined  as  "the  effeat  that  the  C2  system  has  on  improving  the  combat  foroa' a 
ability  to  looate  and  destroy  enemy  tanks". 

It  oan  be  seen  that  performance  is  measured  inside  the  C2  system  while  utility  is  measured  outside  of 
the  C2  system,  Viewed  another  way,  performance  relates  to  ths  teohnioal  capabilities  of  s  C2  systsu 
while  utility  relates  to  how  those  capabilities  ire  exploitsd  so  as  to  improve  the  effectiveness  of  the 
combat  roroe, 

Now  why  is  this  distinction  important?  The  dlstinotion'  is  Importsnt  preolsely  beouuse  it  is  utility, 
and  not  perrormarioe,  whioh  Justifiea  ths  acquisition  of  Cz  system  hardware.  A  partlouler 

oommunioationa  system  or  data  management  system  might  perform  very  well  in  a  teohnioal  sense.  If, 


however,  the  technical  oepabilltlee  oennot  be  exploited  so  ee  to  support  improved  C2  fuiotions,  the 
system  hardware  has  not  been  justified.  In  the  worst  possible  oast,  the  system  hardware  might  prove  to 
be  dysfunotional  and  aotually  degrade  C2  functions. 

While  this  distinction  between  utility  and  performance  seems  obvious,  it  is  sometimes  lost  by  those 
attraoted  to  the  promise  of  new  technology.  For  exaapls,  a  new  communications  system  whloh  is  capable 
of  exceedingly  high  data  transmittal  rates  may  prove  useless  (or  even  dysfunotional)  if  the  reoipient  of 
that  data  oannot  effectively  absorb  or  reasonably  make  use  of  it.  A  particular  data  management  system 
may  be  able  to  store  and  retrieve  an  impressively  large  number  of  faots  concerning  the  oonfllot 
situation.  If,  however,  these  faots  are  not  organised  and  presented  in  a  form  whioh  provides  the 
oommander  with  information  relevant  to  his  deaision  prooeaa,  the  data  management  system  may  be 
essentially  ignored. 

This  brings  the  disoussion  to  the  expressed  interest  in  explicitly  representing  human  deoislon  prooesaes 
in  oonfliot  simulation  models.  Exoept  for  those  C2  systems  whloh  support  automated  weapon  delivery  or 
other  automated  oombat  funotions,  most  taotioal  C2  systems  exist  to  support  human  deoislon  prooesaes. 
These  deoislon  prooesaes,  in  turn,  make  up  the  perception,  assessment,  planning,  dlreoting,  and 
controlling  activities  whioh  guide  the  deployment  and  employment  of  oombat  foroes. 

The  oommander/staff  deoislon  prooesaes  serve  tb  take  the  oombat  Information  provided  by  the  C2  system 
and  produce  oontrol  direotives  for  the  oombat  units.  The  genarlo  process  ooours  at  eaoh  level  within 
the  oommand  hierarchy.  Hence,  the  degree  to  whloh  the  teohnloal  capabilities  of  a  C2  system 
(performance)  translates  into  oombat  force  effectiveness  (utility)  largely  depends  upon  the  human 
deoislon  prooesaes  whioh  intervene  at  eaoh  level  within  the  oommand  hierarohy,  If  the  teohnloal  support 
provided  by  the  C2  system  is  not  matched  to  the  particular  human  deoislon  prooesaes  at  a  given  oommand 
level,  then  the  C2  funotions  and  resulting  foroe  effeotiveness  are  likely  to  degrade. 

Any  analysis  of  C2  system  utility  should  include  an  invaatigatlon  of  the  various  human  dsoision 
processes  supported  by  that  system.  This  requirement  la  refleoted  in  the  key  questions' whioh  emerge  in 
this  type  of  studyi 

Vlhat  are  the  key  oombat  decisions  to  be  supported  by  the  C2  system?  That  is,  whet 
major  options  are  available  to  ths  decisionmakers  involved,  what  orltloal  oonditlons 
must  be  aohieved  (or  avoided),  end  whet  ere  those  points  in  the  dynamic  flow  of  the 
oonfliot  where  oritioal  choices  must  be  made  end  carried  out? 

For  eaoh  key  oombat  decision,  how  is  ths  dooision  likely  to  be  made?  Are  the  key 
deolslons  instantaneous ,  or  do  they  emerge  gradually  through  stepwise  commitments  to 
in  idea  or  plan7  Is  the  deoislon  process  highly  struotursd  with  known  alternative 
courses  of  action?  Or  is  the  deaision  proosss  somewhat  unstructured  beosuse  of 
oartaln  unique  features  or  the  situation?  How  doss  the  deoislon  proosss  sooount  for 
unoertsinty? 

What  typas  of  information  are  considered  relevant  bo  eaoh  kty  deoislon  process? 

Whit  types  of  information  strongly  influence  the  structuring  and  outoome  of  eaoh 
deoislon  prooess?  What  types  of  information  only  moderately  influenoe  eaoh  deoislon 
process? 

What  contribution  does  the  C2  system  make  to  etoh  key  decision  prooess?  Does  the 
C2  system  provide  the  decisionmakers  with  relevant  information  in  s  timely  manner? 

Does  the  C2  eyetem  allow  the  decisionmakers  to  sequentially  refine  their 
information  requests  or  obtain  additional  information,  as  necessary? 

Given  the  range  of  possible  decisions  which  oould  be  made  at  eaoh  oritioal  point  in 
the  oonriiot,  what  difference  do  "good"  decisions  make?  What  is  ths  range  of 
possible  oonsequenoes  at  each  critical  point?  What  subset  of  oonaequenoes  is 
attainable  beoause  of  the  support  provided  by  the  C2  system7 

In  addressing  these  types  of  questions,  the  analyst  attempts  to  undarstand  how  tha  C2  system  serves 
the  partioular  needs  of  the  associated  decisionmakers.  The  form  of  this  researoh  oan  be  either 
daaorlptive  or  normative,  depending  on  the  type  of  C2  system  under  investigation,  For  existing  Cl2 
systems,  the  analyst  is  most  likely  attempting  to  desoribe  the  current  manner  in  whioh  the  system  is 
used,  For  proposed  additions  or  modifications  to  a  C2  system,  the  analyst  is  probably  more  interested 
in  exploring  waya  of  improving  the  deoislon  prooesaes. 

One  tool  available  to  assist  the  apslyst  in  C2  system  research  is  the  simulation  model.  Suoh  models 
must,  however,  portray  in  eoourste  representation  of  both  teohnloal  and  human  elements  within  a  C2 
system.  The  simulation  of  most  technical  elements  in  a  C2  system  is  relatively  straightforward,  given 
the  modex  developer  is  provided  with  suffioient  details  of  these  elements.  In  contrast,  the  simulation 
of  human  elements  hen  presented  e  great  number  of  problems  for  the  model  developer. 

As  oompared  to  questions  or  teohnloal  performance,  modal  developers  have  found  most  aspects  of  human 
behavior  difficult  to  atruoture  and  represent  in  quantitative  terms.  But  wherein  lies  the  dirfloulty? 
Are  the  complexities  of  human  behavior  and  thought  processes  completely  resistant  to  systematic 
understanding  and  modeling? 

To  some,  the  answer  to  this  last  question  appears  to  be  "yes".  Aooord.tngly,  many  analysts  have  largely 
ignored  human  elements  by  adopting  one  or  more  of  the  following  simulation  approsoheei 

Assume  the  C2  system  operates  so  as  to  always  maximize  the  oorahat  effeotlveneas  of 
the  foroe. 
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Assume  that  tha  combat  foroea  operate  aooording  to  fixed  procedure#  and/or  aoriptad 
soenarioa. 

Aooount  for  C2  errors  or  limitations  by  assuming  degradation  factors  for  combat 
force  arraotlvanass. 

Another  group  of  analysts  hava  ohosen  to  utilise  human  gamers  to  simulate  decisionmakers  via  aan-sstohine 
interfaces  with  their  oomputer-driven  oonfllot  models,  In  taking  this  approtoh,  these  analysts  have 
oonoluded  that  human  elements  can,  at  beat,  be  represented  as  "blaok  boxes",  That  is,  they  ohoose  to 
merely  uae  the  results  of  these  deoiaionmakara  rather  than  attempting  to  understand  how  they  operate. 

Yet  another  group  of  analysts  have  aligned  themselves  with  the  fields  of  ooaputer  science  and  knowledge 
engineering  in  an  attempt  to  directly  model  human  decision  prooesses.  To  many  of  these  analysts, 
nothing  is  beyond  the  realm  of  mathematical  description, 

Henoe,  within  the  past  several  years,  a  graat  debate  has  arisen  among  those  who  would  ignore  human 
behavior  in  models,  those  who  would  say  human  behavior  must  be  represented  by  real  people,  and  those  who 
claim  human  behavior  is  eusoeptible  to  mathematical  description,  Who  is  right?  Who  is  wrong? 

In  an  attempt  to  shad  light  on  this  debate ,  the  remainder  of  this  paper  is  devoted  to  disousslng  the 
general  nature  of  taotioal  decision  prooesses  and  to  contrasting  the  strengths  and  limitations  of  using 
human  gamsrs  versus  msthsmstioal  modsls  to  slmulats  suoh  proosssss  in  oonfllot  simulation  modtls. 


A  Brief  survay  of  the  Cognltlvs  and  Bthavloral  Soianoas 

The  cognitive  and  bshaviortl  suianoaa  art  rioh  with  raaaarch  pertaining  to  various  aspsots  of  human 
deoision  prooesses.  This  ressaroh  extends  from  the  elementary  or  neural  level  of  information  prooesses 
to  the  level  of  higher  mental  sotivitlaa  for  both  individuals  and  organisations.  Ths  past  five  or  six 
years  has  ssen  a  rapid  burgeoning  of  information  processing  models  of  oognition  and  tvan  ooaputer 
simulations  of  these  models,  [SIMON,  19791  Henoe,  it  would  seem  natural  for  those  analysts  studying  C2 
systems  to  take  advantage  of  what  has  been  lasrnsd  in  tha  oognitlve/behavloral  fields. 

Because  of  tha  wealth  of  material  which  has  amergsd  from  these  fields,  no  paper  of  this  length  oould 
begin  to  preaent  a  oomplate  disouasion  of  human  deoision  proosaasa.  It  is  important,  however,  to 
briefly  aurvey  a  few  key  oonoepts  whloh  may  assist  tha  development  of  improved  simulation  techniques. 
The  disouasion  of  these  oonoepts  foouaea  on  the  following  general  questions! 

W  * 

Should  we  view  men  so  completely  rational  in  his  dtoisionaxklng,  or  art  thsrs  other, 
more  appropriate  desoriptions  of  hie  bohavlor? 

Should  wa  view  mm  as  exhibiting  only  one  type  of  deoision  prooess,  or  are  there 
several  types  of  deoision  prooesses  involved? 

la  it  possible  to  state  a  general  model  for  human  deoision  prooesses? 

Is  man  completely  rational? 

In  their  book  on  deoision  support  systems,  Keen  *nd  Soott  Morton  deac-ibs  what  they  oonsldsr  to  be  five 
main  perspectives  on  dealaionmaking.  [KEEN,  1978]  They  are 

the  rational  view  of  decisionmaking, 

the  "sabiafioing"  and  proasss-oriented  view  of  deoisionmeklng, 
the  organizational  process  view  of  deolsionmsklng, 
the  view  of  deoisionmeklng  ss  e  political  prooose,  and 
the  individual  differences  view  of  decisionmaking. 

The  rational  view  of  deoiaionmaking  stems  from  the  olasslc  theory  of  mloroeoonomioi  where  man  ia  asriraed 
to  be  completely  rational,  wall-informed,  and  ospable  of  matching  utility  prafersnnne  against  a 
preoisely  defined  goal  or  objective.  This  view  of  man  as  a  rational  and  sxpliolt  daolalonmaker  aligns 
itaslf  closely  with  the  traditional  field  of  systems  analysis.  Hcwevar,  many  reaearohara  rejeot  this 
view  ss  being  too  impractical  and  ideal.  While  rationality  remains  a  dominant  influence  in  olsssloal 
economio  analysis,  many  other  arete  of  doo'.sionaaking  ere  subject  to  inoomplete  knowledge,  ambiguous 
utility  measures,  and  imprsolse  goals,  Henoe,  in  many  instances,  man  is  incapable  of  exeroising 
completely  rational  Judgement. 

The  "satisflolng" ,  prooees-oriented  view  of  deoisionmeklng  focuses  on  how  deoiaionmakara  beet  use  their 
limited  knowledge  end  skills.  Rules  of  thumb  (or  heuristics)  are  said  to  be  employed  by  d«-: isi.onms.kers 
in  n  search  Tor  a  solution  which  is  "good  enough"  instead  of  "optimal".  The  heuristic#  are  simplified 
rules  of  condition  end  ohoioe  whloh  allow  an  individual  to  deal  with  more  oooplex  problems  and 
situations. 

The  organizational  prooeoa  view  examines  both  the  deoisionmaker  end  the  system  within  which  he  operates. 
This  view  atetos  that  systems  (or  organ izetlons)  evolve  standard  procedures  for  dealing  with  moat 
operations.  Decisions  within  a  particular  system  are  largely  determined  by  these  standard  procedures 
which  constitute  its  Institutional  memory  and  store  of  knowledge.  In  scbuel  prsctioe,  ■  system  may  be 
made  up  of  meny  subunits,  each  with  their  own  set  of  standard  procedures  snd  activities.  Haros,  this 
view  also  stresses  organizations!  roles.,  relationships ,  and  oowmin  lost  ion. 
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The  politioal  view  atreaeas  the  degree  of  power  bargaining  associated  with  nany  organizational  daolalon 
processes.  Bargaining  ooours  as  the  various'  subunits  within  s  system  compete  with  one  another  for  power 
and  influence.  hence,  the  oontenta  of  many  deoisions  are  viewed  as  less  important  than  the  proossa  by 
wliloh  they  are  made. 

Tha  individual  difl'arenoea  view  of  deoiaionmaking  focuses  on  the  Information-processing  and 
problem-solving  behavior  of  the  individual  deolalonmaker.  Individuals  are  seen  to. vary  algnlfioantly  in 
their  ability  to  deal  with  problem  complexity  and  Information  lead.  One  theory  argues  that  there  le  an 
optimal  leval  of  information  input  for  any  one  individual  and  that  too  little  or  too  muoh  information 
dagradea  performance.  This  vlsw  of  decisionmaking  also  atraasaa  the  importance  of  Individual  cognltiva 
styla  (analytical  varaua  intuitive)  aid  the  need  to  match  information  input  to  that  style. 

The  various  theorise  Just  presented  should  not  be  interpreted  es  contradictions  to  one  another.  Rather, 
they  are  more  likely  to  be  simultaneously  true  in  varying  degrees  for  any  given  system  or  organization. 
The  relative  dominance  of  any  one  theory  would  depend  upon  conditions  existing  in  the  particular  system 
under  study.  For  a  taotioal  C2  system,  it  is  easy  to  illustrate  aspaots  of  aaoh  theory. 

Tha  rational  view  of  deoiaionmaking  bast  fits  tha  traditional,  doctrinal  image  of  tha  commander  who  is 
supposed  to  flexibly  end  optimally  employ  his  combat  resouroaa  toward  the  aohievement  of  a  presorlbed 
objaotiva.  In  actuality,  tha  impreolsion  of  many  military  objectives  and  the  limited  knowledge  of  the 
aommander/bettle  staff/ support  staff  ire  likely  to  produoe  "satisficing"  type  deoisions.  Although  it  is 
difficult  to  elicit  the  Skaot  heurlstios  employed  in  such  deoisions.  the  existenoe  of  suoh  simplifying 
rule*  of  thumb  ia  hard  to  deny. 

Standard  operating  procedures  also  exist  for  moat  aspaots  of  taotioal  C2  functions  and  they  oen  be 
found  reoorded  in  the  many  operations  manuals  published  by  aaoh  military  service.  Although  these 
procedures  do  not  always  specify  the  exaot  process  by  which  oertain  deoisions  era  to  be  made,  they  do 
serve  as  a  unifying  influenoa  over  the  taotioal  Cz  system,  Htnoa,  it  la  possible  to  predlot  (with 
some  confidence)  the  general  outcome  of  many  taotioal  decision  preosaoas.  Training  and  field  exeroiaes 
are  alao  seen  as  a  means  for  refining  these  procedures  and  insuring  their  uniform  implementation  by  tha 
various  ooramanderu  and  staffs. 

Anyone  who  has  witnessed  inter-servioe  debates  over  combat  roles,  missions,  and  interoperability 
requirements  will  not  dismiss  tha  existenoe  of  politioal  bargaining.  The  degree  to  whioh  this 
bargaining  process  persists  in  wartime  veriea  from  instance  to  instance,  Evidence  from  World  War  II 
suggests  that  even  close  allies  are  not  above  auoh  preotioes. 

Individual  deoision  styles  for  aommandera  ere  an  accepted  faot  within  the  military,  even  though  the 
relative  lmportenoe  of  this  notion  is  not  always  emphasized  in  the  operations  manuals,  Tha  olassioal 
view  of  tha  military  holds  that  a  oertain  amount  of  intuition  and  innovation  ia  expeotad  from  Its 
oommanders.  At  the  same  time,  moat  military  oommanders  are  a  product  of  sohools  whioh  stress  analytical 
problem-solving  styles.  Clearly,  thara  is  need  for  both  intuition  and  enelytloal  thought)  but,  the 
exaot  role  played  by  aaoh  in  combat  la  a  funotion  of  tha  individual. 

Does  man  exhibit  only  one  type  of  deoision  process? 

Much  of  the  bauia  oognitlve  research  to  date  has  fooused  on  the  mechanisms  Involved  with  solving 
well-structured  problems.  Models  describing  auoh  processes  hive  reached  a  considerable  state  of 
development,  Roaearah  in  more  oemplex  areas  of  cognition  euoh  ts  semantic  (or  long-term)  memory, 
learning,  motivation,  and  amotions  have  felled  to  produoa  similar  progress.  There  le  evidenoe  to 
suggest,  however,  that  the  human  mind  involves  more  then  one  type  of  problem-solving  or  deoiaionmaking 
proa  ess, 

One  oonaept,  referred  to  oommonly  as  right  and  left  brain  prooasses,  distinguishes  between 
verbel/logiotl/linear  prooesses  whioh  ere  said  to  ooour  predominantly  in  the  left  hemisphere  of  the 
brein  end  the  nonverbal/intuitive/holistio  prooesees  whioh  ooour  predominantly  in  the  right  hemisphere. 
As  suggested  by  Streuoh,  this  distinotion  is  important  in  many  deoision  or  assessment  prooesses. 
tSTRAUCH,  19741 

On  the  nonverbsl/intultive/holistio  level,  the  brain  deals  with  oonoepts,  spatial  relationships,  and 
analogies  as  s  whole  proceaa  or  Qeatalte,  It  la  at  this  nonverbal  level  where  intuition  operates, 
aretional  thought  ooours,  and  faalinga  or  emotional  values  find  signifloanoe.  It  is  also  at  the 

nonverbal  level  where  deoisionmakers  oonatruot  their  own  "internal  model"  of  the  problem  situation  or 

environment. 

On  the  verbal/iogiotl/lineur  level,  the  brein  deals  with  language  end  ibe  literal  meaning.  language  as 
defined  hare  inoludes  both  natural  language  (suoh  as  English  or  f'renoh)  and  mathemationl  language 
(numbers,  symbols,  and  funotions).  Hsnoe,  it  ia  at  the  verbal  lavel  where  oomaunioation  with  other 
humans  takes  plaos.  Spasch,  mathematics,  logioel  argument,  end  quantitative  analysis  all  belong  to  the 
verbal  prooesses  or  the  brain.  The  digital  oomputer  (with  its  mathematloal/locioel  foundation)  ia 
merely  an  external  extension  of  this  verbal  thought  proossa. 

While  these  two  levels  of  thought  ere  complementary  to  one  another,  they  are  still  distinct  processes. 
Hanoe,  we  ere  unable  to  precisely  define  nonverbal/intuitive/holistio  thoughts  in  verbal  terms,  For 
example,  we  often  find  it  diffioult  to  verbally  express  t  precise  notion  or  internal  image.  Conversely, 
as  wo  listen  to  others  verbalize  an  idea,  we  oan  suddenly  produoe  a  "flash  of  Insight"  as  our  nonverbal 
thought  prooeae  diaoovera  a  familiar  paradigm  or  Image,  Image  communication  oan  often  transmit  ideas 
whioh  ere  diffioult  or  impossible  to  verbalize  (sudh  as  "a  pioture  being  worth  a  thousand  words"), 

Perhaps,  a  more  profound  impliaation  for  the  systems  analyst  is  that  we  ere  limited  in  our  ability  to 

Bsthsnstiaslly  model  nonverbal  deoision  processes.  Mathematics,,  itself  being  based  upon  left  brein 
thought  prooesses,  may  Inherently  be  inaepeble  of  representing  right  brain  thought  processes.  If  so, 
this  conclusion  hsj  great  significance  for  the  simulation  mods!  developer.  Indeed,  we  might  hive  to 
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await  the  development  of  a  completely  different  oomputer  (one  baaed  on  image  prooeaaing)  before  we  oan 
suooeaefully  model  aapsota  of  right  brain  aotlvlty. 

To  complete  this  discussion  of  the  various  modes  of  thought,  It  is  Interesting  to  review  what  Soviet, 
authors  have  to  say  about  this  subjeot.  In  their  book  on  deoiaionmaking  and  automation,  Druzhlnin  and 
Kontorov  suggest  that  deoisionmaking  involves  several  modes  of  thought,  depending  upon  the  complexity 
and  uniqueness  of  the  problem  situation,  [DRUZWININ,  1972]  These  modes  are  defined  as  follows! 

Empirical  thought  -  criantation  and  raaotlon  according  to  aimpls,  ready-made 
patterns.  The  observed  problem  situation  is  Identified  with  a  paradigm  stored  in 
memory,  In  response,  a  stereotypical  reaotion  ia  selected  and  realized.  Btplrioal 
thought  represents  the  sooumulation,  systematization,  and  organization  of 
experianoe. 

Axlomatlo  thought  -  reaction  according  to  a  system  of  rules  (or  axioms).  The 
observed  problem  situation  is  tested  through  the  application  of  appropriate  rules. 

A  rssponse  is  logloally  derived  from  the  application  of  thaae  rules.  Eaoh  rule 
refleots  a  oonoentratlon  of  aoslal  experianoe  which  is  held  to  be  true  by  the 
deoisionmaker. 

Dlaleotle  thought  -  the  detection  and  resolution  (or  synthesis)  of  a  basio 
oontradiotion  in  the  problem  situation.  Dlaleotlo  thought  represents  a  threshold 
transition  or  qualitative  jump  to  a  new  oreative  idea.  It  is  a  process  whloh  ooours 
unoonsolously. 

Stored  knowledge  and  pattern  recognition  art  both  involved  to  varying  degrees  in  aaoh  mods  of  thought 
presented  by  the  Soviet  authors,  Eapirioal  thought  makss  the  moat  rigid  use  of  stored  knowledge  and 
pattern  reoognition  while  dialeotia  thought  makes  the  moat  flexible  use  of  esoh.  A  deoisionmaker  is 
oapable  of  employing  waoh  mode  of  thought ,  usually  ssleoting  one  on  the  besis  of  the  degree  of 
familiarity  and  complexity  in  a  given  problem  situation. 

In  comparing  the  Soviet  views  with  those  of  verbal  and  nonverbal  thought,  one  sees  some  similarity,  for 
example,  axiomatio  thought  involves  predominantly  varbal/logloal/llnsar  proosssts  while  dlaleotlo 
thought  involves  predominantly  nonverbal/.intuitive/holiatio  processes.  Empirlosl  thought  may  involve 
either  verbal  or  nonverbal  prooessea,  depending  upon  the  degree  to  whloh  experience  has  been  assimilated 
into  the  suboonsoious  (a  reflex), 

Ia  there  a  general  model  for  dsolalon  processes? 

As  mentioned  earlier,  muoh  of  the  past  cognitive  rasearoh  has  focused  on  problem-solving  models  for 
well-sbruatured  tasks.  That  ia,  the  problem  apaos  or  domain  is  assumed  to  be  fairly  weLl  oonoaptuallzad 
by  the  decisionmaker.  In  addition,  thaae  problem  domains  were  relatively  simple  and  required  little,  if 
any,  specialized  knowledge. 

Recently,  this  work  has  been  expanded  into  semantically  rich  problem  domains.  [SIMON,  1979)  A 
semantlaally  rich  problem  domain  ia  one  whloh  requires  specialized  knowledge,  aa  well  to  for  general 
problem-solving  skills.  Muoh  of  this  reoent  work  has  focused  on  the  organization  and  storage  of  "expert 
knowledge"  in  long-term  memory. 

A  significant  view  whloh  has  oraerged  from  this  resesroh  is  the  oonoept  of  the  "production  system"  A 
production  system  is  a  sat  of  instruotions  oalled  productions.  Esoh  produotion  involves  a  oondition 
statement  and  a  corresponding  action.  The  aation  (whloh  may  be  a  oonoluslon  or  Judgement  oonoerning 
some  aspect  of  a  problem)  is  executed  whenever  the  oondition  Is  satisfied.  Conditions  generally  relate 
to  some  feature  of  the  problem  domain. 

Reoent  experience  with  studying  decisionmaking  in  chess,  medioal  diagnosis,  and  other  specialized 
knowledge  fields  suggests  the  importance  of  produotion  systems  in  storing  "expert  knowledge".  The 
oonditiop-aotion  pair  in  productions  have  been  relsted  by  some  reoenrohers  to  the  stimulus-response 
theory.  Unfortunately,  historical  experience  suggests  that  it  is  often  difficult  to  extraot  expert 
knowledge  from  people  in  a  ryotematio  manner.  Considerable  interaction  between  the  expert  and  the 
analyst  is  required  to  eliait  a  robust  set  of  productions  from  people  who  are  not  used  to  consciously 
thinking  about  their  own  problem-solving  heuristios.  [WATERMAN,  19773 

A  second  branoh  of  problem-solving  research  has  dealt  with  problem  understanding  nr  deaoriptlon.  Unlike 
the  well-struotured  problems  studied  by  many  earlier  researchers,  problems  in  real  life  aro  not  always 
well  defined.  Henoe,  before  speoific  knowledge  and  problem-solving  procedures  oan  be  employed,  a 
deoisionmaker  must  often  first  determine  what  kind  of  problem  is  faoed, 

Some  psychologists  have  defined  this  Initial  step  as  an  attempt  to  resolve  ambiguities  In  the 
deoisionmaker’ s  peroeivad  environment.  Thet  is,  a  decisionmaker  must  first  make  aense  of  his  situation 
before  he  oan  propose  and  assess  alternative  courses  of  action,  In  "making  sense"  of  his  situation,  the 
deoisionmaker  Is  comparing  his  peroeived  environment  with  previously  stored  experiences.  In  doing  so, 
he  is  seeking  to  reoognize  analogies  or  problem  ioomorphs  whioh  will  either  suggest  a  solution  to  him 
or,  at  least,  define  the  nature  of  the  problem  he  is  faoed  with. 

Aooordlngly,  a  deoisionmaker  will  seek  additional  information  about  his  environment  (or  will  test  his 
environment)  in  order  to  resolve  any  remaining  ambiguities  in  his  peroeptton.  Only  at  the  point  where 
further  problem  resolution  is  lmpraatioal  will  the  deoisionmaker  rely  on  pure  judgement, 


Several  authors  have  suggested  that  it  is  Important  to  capture  this  aapaot  of  the  dsolaior.  process  in 
any  attempt  to  model  daoisionaeking.  Dreyfus  and  Dreyfus  disouaa  this  envlronaental  perception  step  in 
their  informal  model  of  deolsionmaking.  [DREYFUS,  undtd]  They  oontrast  the  need  to  first  establish  the 
context-dependent  aspects  of  the  situation  with  the  contrary  assumption  in  rormal  decision  models  that 
these  aspects  are  already  known. 

A  second  pair  of  reaaarohers,  Aldrich  and  Lavlt,  deaoribe  muoh  thu  same  idea  in  their  development  of 
"frame  theory"  as  a  model  for  daoisionaeking.  [ALDRICH,  1978]  In  thla  latter  work,  baaed  on  a  conotpt 
by  Minsky,  thee#  authors  desoriba  how  daoiaionmakera  aeek  to  eatablieh  a  framework  for  eaoh  problem. 
[MINSKY,  1978]  Each  framework  (or  action  frame)  oontains  the  following  unique  prooedu  ll  information! 

Aotivation  conditions  which  determine  when  to  adopt  the  frame 

Types  of  information  needed  to  support  the  decision  proasss 

Procedures  for  developing  alternative  aolutiona 

Procedures  for  evaluating  alternative  aolutiona 

Procedures  fur  selecting  among  the  evaluated  solutions 

Procedures  for  implementing  the  seleoted  solution 

Keen  and  Soutt  Morton  also  allude  to  s  similar  oonoept  when  they  dlsousa  the  degree  of  "etruotura" 
assooisted  with  e  given  problem  situation,  "Structure, "  as  defined  by  these  authors,  predetermines  the 
problem-solving  procedures  to  be  invoked,  thn  types  of  computation  and  analysis,  and  the  information  to 
be  uaed.  Unlike  their  "rational"  deulsionmaker  who  approaches  every  problem  in  the  seme  manner,  Keen 
end  soott  Morton  suggest  that  problems  can  vary  aignifioantly  in  struobure  (or  be  unstructured) .  Hsnoe, 
decision  prooesaes  are  highly  varitbls,  depending  upon  the  degree  end  type  of  problem  etruotura 
perceived. 

For  simulation  model  developers,  these  various  researoh  findings  suggest  that  most  decision  prnoasscs 
can  bs  viewed  as  a  two-stags  aotlvity.  In  the  first  stage,  the  deolslonmaker  is  attempting  to  define 
his  environment  and  identify  the  context  in  whioh  he  is  to  make  a  decision.  Having  identified  thia 
oontext  (or  etruotura),  the  dsoiaionmaker  then  invokes  a  predetermined  set  of  problem-solving  prooedurea 
or  haurlstios  to  arrive  at  a  desired  aourse  of  action. 

For  decisions  involving  uncertainty  and  risk  (s  oharsoterlstio  on  many  taatloal  combat  deoieiona), 
production  systems  and  frame  theory  may  prove  to  model  human  behavior  vary  olosely.  Rcoent 
Investigations  of  decisionmaking  under  uncertainty  suggest  that  humans  systematically  violate  the 
principles  of  rational  thought  when  attempting  bo  assess  likehood,  make  predictions,  or  otherwise  deal 
with  probabilistic  tasks.  [SLOVIfi,  1976]  The  notion  that  heuristios  and  biasea  aignifioantly  lnriuanoe 
probabilistic  Judgements  has  gradually  replaced  the  oonoept  of  Bayesian  behavior  in  humane.  These 
heuristios  and  binsoa  arc  based  on  psraeived  similarities  of  evsnts  and  prooesaes,  familiarity  or 
evsnts,  and  the  adoption  of  initial  perceptions  or  Judgements. 

Before  concluding  this  tsplo,  it  should  be  pointed  out  that  there  may  stiU  axiab  aapaots  of  dsolalon 
prooesaes  whioh  are  not  completely  desoribed  by,  two-stage  aotivities  end  production  systems.  The 
earlier  discussion  of  nonverbel/intultive/hol istio  thought  suggests  that  the  brain  is  capable  of  image 
processing,  as  well  as  symbol  processing.  The  general  subjeot  of  pattern  recognition  (whioh  la  key  to 
frame  theory)  involves  aspects  of  semantic  memory  whioh  have  not  olearly  been  defined. 

Thus,  in  reviewing  the  existing  research,  one  is  oapeblo  of  constructing  only  e  partial  model  of 
decisionmaking .  Increasing  interest  In  this  field  of  solonoe,  however,  suggests  that  future  research 
will  add  to  our  understanding  and  modeling  of  decision  processes. 


An  Illustration  of  Each  Simulation  Approach 

The  dlaousalon  now  turns  to  the  ilternetlve  approaches  defined  for  representing  human  thought  and 
response  in  oonfliot  simulation  models.  To  illustrate  the  sssential  oharauteristios  of  eaoh  approach, 
examples  of  their  application  to  two  different  USAF  simulation  efforts  ere  briefly  highlighted,  These 
two  examples  illustrate  the  simulation  of  essentially  the  seme  oonfliot  situation.  A  principal 
difference  between  the  two  simulation  models  is  the  method  used  to  represent  human  dec islonmiking . 

Tactical  Air /Land  Operations  Simulator  (TALON) 

TALON  is  an  interaotlve  simulation  modal  of  oombtned  air/land  oombat  operations.  [USAF/TP'WC,  1978]  It 
is  essentially  a  computerized  extension  of  a  manual  war  gome,  with  tactical  decisions  reserved  to  human 
gamers  and  all  bookkeeping  tasks  performed  by  the  computer,  The  original  version  of  TALON  was 
introduoed  as  a  USAf  methodology  by  the  Assistant  Chief  of  Staff,  Studies  end  Analyses,  Continued 
development  responsibility  has  now  been  transferred  to  the  USAF  Tsaploil  Fighter  Weapons  Canter. 

TALON  portrays  (in  its  present  form)  a  two-sided,  theater  or  oorps-levsl  ground  oonfliot  situation  along 
with  the  aseoolated  air  strike  and  reconnaissance  operations  provided  by  a  teotioal  sir  foros.  Ground 
unit  resolution  depends  upon  the  scale  of  oonfliot  seleoted  (e.g.,  battsl ion-lsvel  resolution  is 
provided  for  e  oorpa-.lovel  oonfliot). 

The  TALON  ground  war  module  simulates  movement  and  attrition  of  maneuver/aupporting  ground  units. 
Ground  combat  attrition  is  derived  from  modified  Lsnohester  equations  calibrated  to  the  results  of 
mlaro- simulations  of  battalion-level  operations.  Unit  strengths  are  expresasd  as  "tsnk  equivalent?"  to 
provide  the  human  gamers  with  an  intuitive  notion  of  *ai.h  unit's  potential  killing  rate  against  enemy 
units . 


Air  strikes  (oIom  air  support  and  lntardlotion)  art  not  modeled  In  thalr  entlrity ,  Instead,  the  TALON 
air  attaok  nodule  focuses  on  the  tnd-gane  dataila  of  ground  target  acquisition  and  air  nunitlona 
effaotivaness.  Air  attaoka  against  ground  units  serve  to  reduoe  unit  strength  and  oause  aovenent 
delays. 

Air  reoonnaisaanoe  operations  simulated  by  TALON  inoluda  both  data-gathering  and  date-fusion  activities. 
The  date-fusion  aotivity  provides  a  consolidated  perception  of  the  battlefield  for  the  human  genera. 
The  aaauraoy  and  'ooapletaneas  of  this  perceived  pioture  of  the  battlefield  ua  a  funotion  of  the 
frequency,  ooverage,  and  quality  of  the  airborne  reconnaissance  sensors  portrayed  in  TALOH. 

Gamer  interactions  with  TALON  are  depicted  in  Figure  1.  Taotloal  decisions 'provided  by  the  hwatt  genera 
are  organised  according  to  air  strike  planning,  ground  operations  planning,  and  reconnaissance  mission 
planning.  Those  tactical  decisions  are  input  to  TALON  at  predetermined  intervals  during'  the  execution 
of  the  simulated  confliot. 

Air  strike  planning  Involves  matohing  available  air  sorties  to  speoiflo  enemy  ground  targets.  Ground 
operations  planning  inoludes  the  specification  of  path-points  for  unit  movement  and  the  assignment  of 
fire  support  to  maneuver  units.  Reconnaissance  planning  involves  the  soheduling  of  sensor  overflights 
for  antmy  target  areas  of  interest. 

Through  interactive  graphics  displays  and  a  asquanoa  of  structured  quastiona/rasponsea,  the  TALON  gamers 
oan  request  a  variety  of  information  displays  and  input  a  variety  of  planning  daoiaiona,  Information  is 
displayed  in  both  tabular  and  map  form.  This  offers  the  gamers  a  variety  of  Information  sources  and 
formats  to  assist  thsm  in  forming  s  perception  of  the  oonfliot  situation. 

For  air  atrikes,  TALON  offers  an  automatio  sortie  ulloostion  feature  which  relieves  ths  gtasra  of  this 
decision  task.  The  automatio  allocation  may  ba  overridden  by  the  gamers,  if  they  so  desire.  For  ground 
operations,  unit  path-points  are  generally  prespeo tried  at  tha  beginning  of  ths  simulation  run. 
Adjustments  to  thasa  movement  plans  may  ba  input,  however,  if  warranted  by  the  oonfliot  situation. 
Renonneissanoe  flights  may  ba  soheduled  individually  or  recursively  throughout  tha  simulation  run. 

Great  emphasis  is  placed  on  the  use  of  human  gamers  within  TALON.  Although  speoiflo  elements  of  tha 
ground  and  air  oommand  hternrohies  are  not  represented,  the  consolidated  gamer  term  is  expoeed  bo  the 
general  perceptions  and  problem  situations  faced  by  real  planning  staffs.  Tha  laok  of  a  detailed  C2 
system  arohiteoture  in  TALON  prohibits  its  use  for  studying  issues  involving  distributed  deolsion 
processes.  The  model  does  provide,  however,  an  opportunity  for  the  human  gamers  to  use  their  total 
oognitlve  capabilities  to  influanae  the  oourse  of  the  simulated  oonfliot. 

To  date,  TALON  hae  been  employed  in  support  of  various  studies  dealing  with  combined  arms  operations. 
TALON'S  utility  has  been  demonstrated  by  the  firat-order  insight  it  provides  to  Issues  involving  the 
value  of  air  strike  and  reoonnaissenae  resouroes  and  the  synergism  between  land  and  air  foroea. 

\  TAC  ASSESSOR 

TAC  ASSESSOR  is  also  a  simulation  modal  of  oomblned  air/land  oombat  operations.  [USAF/SA,  1978]  Tha 
ground  and  air  operationa  are  simulatad  in  muoh  tha  same  manner  aa  those  portrayed  in  TALON.  In  faot, 
both  mod  el  a  are  derivatives  of  an  earlier  simulation  model,  Taotloal  Warfare  Simulation  Program  (TVISP). 
ThA  unique  feature  of  TAC  ASSESSOR  is  the  C2  struoture  overlaid  onto  tha  ground  and  air  oombat  modal. 
Thig  C2  struoture  embodies  production  systems  and  other  aomputer  sulenoe  techniques  to  explicitly 
represent  the  taotioel  deolsion  processes  of  the  various  C*  elements.  Development  responsibility  for 
this  USAf  model  resides  with  the  Assistant  Chief  of  Staff,  Studies  and  Analyses, 

TAC  ASSESSOR  portrayes  a  two-sided,  oorps-level  ground  oonfliot  situation  plus  the  associated  air 
missions  of  oloso  air  support,  battlefield  interdiction,  reoonnalaaanoe ,  and  defense  suppression, 
around  oombat,  sir  strike,  and  reconnaissance  relationships  are  essentially  ldentloal  to  those  simulated 
in  TALON. 

The  ground  '  force  C2  struoture  Is  explicitly  portrayed  for  oorpa  headquarters  down  through  each 
battalion  headquarters,  the  air  force  Cz  struoture  le  explicitly  portrayed  for  eauh  element  of  a  USAF 
Taotloal  Air  Control  System  { TACS ) .  These  various  headquarters  and  oontrol  elements  are  illustrated  in 
Figures  2  and  J, 

Prime  emphasis  in  TAC  ASSESSOR  is  plaaed  on  the  use  of  production  systems,  signature  tables,  dlraoted 
relational  graphs ,  and  other  computer  science  techniques  to  model  various  aspeota  or  taotloal 

decisionmaking,  The  model  user  is  provided  with  s  generio  decision  structure  for  eaoh  ground 
headquarters  plus  e  flexible  Language  with  whloh  to  create  produobion  systems.  Figure  4  illustrates 
this  generio  deolsion  structure  for  a  typical  ground  headquarters. 

The  user  may  aooeos  and  modify  tha  production  systems  for  any  particular  ground  headquarters  vie 

lnteraotive  grtphioe  displays.  In  this  manner,  the  user  may  tast  and  refine  various  heurlstios  sets 
whioh  desorlbs  the  behavior  of  eaoh  headquarters.  A  typical  set  of  heuristics  and  corresponding 
production  system  are  illustrated  In  Figure  5. 

Another  deolsion  modeling  technique  extensively  employed  in  TAC  ASSESSOR  is  the  signature  table.  A 
signature  table  extreots  Important  information  about  a  given  problem  domain  by  examining  meaningful 
combinations  or  problem  features,  This  versatile  technique  (a  generalised  form  of  decision  loglo 
tables)  oan  be  used  to  represent  skilled  deo isionmekers  who  focus  on  combinations  of  key  problem 
features  (celled  a  signature). 

Figure  6  illustrates  a  typioal  use  of  signature  tables  in  TAC  ASSESSOR.  The  example  shown  represents 
one  step  in  the  complex  proosss  of  updating  a  perceived  battlefield  pioture  when  a  reoonnaissancs 

mission  deteats  a  new  enemy  ground  unit.  In  this  step,  the  newly  deteoted  ground  unit  is  oompared  to 


nearby  units  already  identified  from  previous  reoonnalssanoo  reports.  Here  the  .comparison  is  made  on 
the  basis  of  observed  vshiole  types  within  eash  unit,  lhe  output  of  the  signature  table  is  a  subjective 
asuessment  of  how  nearly  matched  the  units  are  (by  vehiole  type).  Other  tables  are  used  in  hierarchical 
form  to  make  other  types  of  comparisons  (e.g.,  unit  location  and  unit  velooity).  The  total  set  of 
tables  simulate  the  llkoly  decision  prooeas  of  a  skilled  intelligence  officer  determining  whether  he 
has  deteoted  a  new  unit  or  has  Just  assn  a  prtvlously  ldantlfied  unit  whioh  has  relocated. 

i  tv, 

Also  simulated  within  TAC  ASSESSOR  srs  ths  communication  nets  whioh  link  the  vsrlous  headquarter* 
oontrol  centers,  asnsors,  and  aircraft  flights.  Thaaa  ooooun  lost  ion  nets  must  exist  in  order  for 
messages  and  reports  to  flow  among  the  various  dsoision  oentsrs.  It  is  ths  flow  of  massages  and  reports 
whioh  trigger  the  individual  deolsion  processes  throughout  TAC  ASSESSOR. 

To  data,  TAC  ASSESSOR  has  bean  used  to  investigate  the  extent  to  whioh  taotioal  deolsion  prcoeesea  oan 
be  mathematioally  represented.  As  suoh,  the  model  represents  s  major  break  from  traditional  oonfliot 
simulation.  Its  developers  will  oonbinua  to  teat  ths  behavior  of  TAC  ASSESSOR'!  simulated  headquarters 
and  control  centers  In  an  attempt  to  refine  and  augment  the  various  deolsion  processes  represented. 


Advantages  and  Limitations  of  Eaoh  Simulation  Auproaoh 

A  comparison  of  simulation  models  like  TALON  and  TAC  ASSESSOR  reveals  that  eaoh  simulation  approach  has 
relative  advantages  and  disadvantages.  Henoe,  it  is  not  the  purpose  of  this  paper  to  generally  favor 
one  model  over  the  other.  To  explore  these  advantages  and  disadvantages  in  more  detail,  ths  dissuasion 
foouses  on  the  following  attributes  of  C2  representation  within  this  class  of  simulation  model  i 

Scope  and  resolution 

Transparency 

Consistency 

Fidelity 

Teohnloal  risk 

Scope  and  Resolution 

Scope  is  defined  here  bo  mean  the  extent  to  which  the  total  C2  system  is  represented  in  the  oonfliot 
simulation  model.  That  Is,  how  many  command  eohelons  of  «aoh  force  component  are  aooountad  for  in  the 
model?  Resolution  rsrsrs  to  the  level  of  detail  provided  for  eaoh  C2  echelon  represented.  That  is, 
to  what  degree  are  the  individual  C2  elements  explicitly  portrayed  in  the  model? 

Experience  suggests  that  the  use  of  human  gamers  bo  simulate  taotioal  doolslonmakers  is  expansive  in 
terms  of  both  facilities  end  personnel.  The  limited  availability  of.  gaming  faoiliblea  and  qualified 
personnel  will  generally  tend  to  restrict  the  number  of  pieces  where  human  gamers  lntaraot  with  the 
computer  simulation.  This,  in  turn,  reetriots  the  aoop*  and  resolution  of  the  simulated  C2  syatem 
since  decision  processes  must  be  aggregated ,  simplified,  or  ignored  to  correspond  with  available  gamer 
resources . 

The  use  of  oomputer  science  techniques  to  represent  deolsion  processes  reduoes  the  need  for  supporting 
gaming  facilities  and  personnel.  Hence,  the  use  of  such  teohniques  makes  possible  (at  least 
potentially)  the  study  of  distributed  decision  processes  in  large  C2  systems. 

Transparency 

Transparency  is  defined  to  mean  the  degree  to  which  C2  processes  are  explicitly  observable  In  the 
simulation  model.  For  examplo,  can  the  analyst  trace  the  influence  of  oombat  Information  on  the 

management  of  foroea  by  a  given  command  echelon? 

With  the  use  of  human  gamers,  the  analyst  oan,  at  bast,  only  indirectly  observe  the  internal  operations 
of  the  C2  system.  Questions  involving  the  match  betwoon  taotioal  decision  processes  and  the  technical 
support  provided  by  the  C2  system  oan  be  addressed  only  through  inference. 

The  use  of  computer  scienoe  techniques  for  representing  deolsion  proosssss  provides  an  explicit 
description  of  the  C2  processes,  Consequently,  ths  analyst  is  sble  to  direotly  trees  the  effects  of 
the  C2  system's  teohnloal  support  on  C2  functions. 

Consistency 

Consistency  is  defined  os  ths  ability  of  the  modal  to  produoo  repeatable  and  congruous  behavior  over  a 
range  of  appropriate  conditions.  Consistency  is  easantlsl  to  the  comparison  of  simulation  results 
produced  during  different  executions  of  the  model.  In  particular,  ths  analyst  must  be  assured  that 
variations  in  model  output  are  due  to  intended  changes  in  model  parameters  and  not  because  of 
unexplained  deviations  in  the  deolsion  processes. 

Thera  is  no  guarantee  of  conslateiioy  when  human  gamers  are  uued  to  represent  the  deolsion  prooessee  in  a 
conflict  simulation  model.  Changes  in  gaming  personnel  are  likely  to  introduo*  nonoontrol lable 
deviations  in  model  output  through  the  influence  of  gamer  personality  and  skill  level.  Evan  if  there 
are  no  ohanges  in  gaming  peraonnal,  the  analyst  must  oontend  with  the  possibility  or  learning  effects. 
That  Is,  the  behavior  or  the  gamers  may  vary  over  time  as  they  become  more  familiar  with  the  setting  and 
operation  of  the  simulation. 


On*  teohniqut  used  to  provide  consistency  over  *  United  set  of  conditions  involves  the  recording  of 
Kiser  decisions.  In  certain  simulation  models,  a  standard  set  of  tactical  decisions  made  by  the  gamers 
may  be  repeatedly  used  in  subsequent  executions  of  the  model.  This  technique  is  applicable  only  in 
situations  where  ahanges  to  other  parameters  and  operations  would  not  have  normally  resulted  In 
different  decision  outoomes  it)  e&oh  step  of  the  simulation. 

The  use  of  oomputer  soience  techniques  provides  s  consistent  framework  for  representing  decision 
prooessee  within  s  eonfliot  simulation  modal.  Behavior  is  completely  speoified  by  the  model  developer 
through  mathematical  expressions  and  formulations.  If  variable  or  atoohastic  behavior  is  dasirwd,  this 
osn  ba  produoed  through  dslibersts  modifications  to  the  appropriate  production  systama,  signature 
tables,  and  so  on. 

Fidelity 

Fidelity  Is  defined  as  the  extent  to  whioh  the  behavior  of  the  simulation  model  matches  the  behavior  of 
the  real  world.  That  is,  the  model  should  faithfully  reproduce  real  world  behavior  over  an  appropriate 
range  of  oonditions.  The  modal  should  ba  robust  in  that  It  doaa  not  produce  absurd  results. 

It  would  appear  that  the  use  of  human  gamsra  has  an  advantage  over  the  use  of  computer  srienoe 
techniques  in  bhia  regard.  Quit*  aiaply,  nothing  represents  a  human  decisionmaker  as  faithfully  as  a 
real  person.  Our  limited  knowledge  of  human  decision  processes  and  our  limited  ability  to  model 
different  aspects  of  thoa*  proceaaes  suggeat*  that  fidelity  ia  difficult  to  aohieve  with  oomputer 
aoienoe  techniques.  Production  systems,  signature  tables,  and  so  on  art  tha  products  of  historiosl 
experience  end  problem  underatending.  New  and  unique  problem  o  ire  urns  teiioes  may  *r  las  whioh  do  not  fit 
existing  conceptions-  Hencs,  ths  user  of  euoh  techniques  must  continually  test  to  insure  that  the 
undarlylng  conceptual  foundations  have  not  been  violated  by  new  conditions. 

The  use  of  human  gamers,  however,  has  its  own  sat  of  fidelity  problems.  Thera  are  several  feotors  whioh 
influanoe  the  ability  of  human  gamers  to  faithfully  represent  combat  decisionmakers,  Among  those 
factors  are  ths  level  of  tsatiosl  skill  snd  experience  possessed  b>  the  gsmere,  the  motivation  of  tha 
gamers,  snd  the  level  of  psyohological  stress  provided  in  the  gaming  environment.  In  short,  ths  analyst 
must  teke  positive  measures  to  achieve  a  reasonable  level  of  fidelity  with  both  approaohea  to 
representing  deolslon  processes. 

Technical  Risk 

Taohnioal  risk  is  defined  aa  the  degree  of  difficulty  likely  to  be  encountered  in  developing  a 
satisfactory  simulation  model.  Given  that  a  particular  approach  ia  selected  for  representing  deoision 
processes,  what  ia  the  likelihood  of  producing  a  useable  model? 

The  use  of  human  gamers  to  represent  deoision  processes  entails  little  risk  in  the  Initial  development 
of  a  eonfliot  simulation  modal.  With  this  approach,  tha  model  developer  does  not  have  to  bo  oonoerned 
about  tha  Internal  details  of  the  deoision  proossses.  However,  the  model  developer  may  later  be  feoed 
with  problems  of  scope,  resolution,  transparency,  or  consistency,  depending  upon  tha  Intended  us*  of  the 
model,  Thus,  soma  risk  may  be  involved  with  aohieving  a  model  whioh  completely  satisfies  the  analyst's 
needs. 

On  the  other  hand,  the  use  of  computer  aoienoe  techniques  to  reprosent  deoision  processes  entails  risk 
from  ths  start.  The  davelopmsnt  of  robust  decision  models  depends  upon  a  comprehensive  understanding  of 
thu  problem  domains  and  deaiaion  prooaases  involved.  Our  limited  knowledge  of  deoision  proossses  in 
semantically  rich  problem  domains  makes  this  task  arduous  Tor  most  tactical  situations.  Indeed,  one 
doaa  not  even  know  the  extant  to  which  deaiaion  processes  can  be  modeled.  Thus,  the  risk  involved  with 
produolng  a  satisfactory  model  is  more  directly  visible,  if  not  greeter,  with  this  approach  to 
representing  deoision  processes. 


Observations  and  Conslderstlona  for  the  future 

As  eumrairlxed  in  Figure  7,  esoh  approach  to  simulating  tactical  deoision  processes  offers  tho  analyst 
relstiva  advantages.  The  uae  of  human  gamara  in  conflict  simulation  models  offers  greater  potential  for 
fidelity  and  incurs  only  moderate  risk,  The  uae  of  oomputer  soience  techniques  provideo  ths  analyst 
With  greater  potential  for  increased  model  scope,  reeolution,  transparency  snd  consistency. 

It  would  aeem  attractive,  therefore,  to  seek  ways  in  whioh  theae  different  advantage;;  oould  be  exploited 
to  aerve  the  needs  of  tha  analyst.  Accordingly,  ths  remainder  of  the  paper  provides  come  thoughts  on 
how  both  modeling  approaohea  oould  be  combined  into  an  experimental  teetbed  facility  Tor  the  study  of 
tha  human  component  in  tactical  C2  systems. 

Returning  for  s  moment  to  the  cognitive  research  rtisousssd  earlier.  It  can  be  observed  that  several 
interesting  theories  have  emerged  to  guide  our  understanding  of  tactical  deoision  proossses  in  C2 
systems,  For  example,  the  work  or  Keen  and  Soott  Morton  suggests  that  it  is  important  for  the  analyst 
to  understand  various  aspects  of  decisionmaking,  not  all  of  whioh  fit  the  rational  man  image.  Results 
of  other  researah  imply  the  existence  of  different  types  of  cognitive  prooessee,  only  one  of  whioh  fits 
the  analytioal  definition.  Still  additional  researoh  has  begun  to  explore  the  complexities  of 

asmantioally  rich  problem  domains  and  tho  behavior  of  man  in  dealing  with  those  domains. 

A  major  premise  held  by  the  author  ia  that  the  simulation  model  developer  aen  both  exploit  and  assist 
the  type  of  oognitivo  research  juat  cited.  The  model  developer  oan  exploit  this  researoh  by  using  ita 
theories  and  findings  to  build  a  more  robust  conceptual  framework  for  modeling  and  studying  the  human 
aspeot  in  C2,  The  model  developer  uan  assist  oognitlva  nolenoe  by  providing  a  oonvenient  and 

realiatio  environment  for  applied  researoh. 


One  approach  to  linking  the  simulation  model  with  cognitive  reaearoh  la  the  development  of  an 
experimental  C2  testbed.  The  essential  features  of  this  testbed  Include  a  basic  oonfliot  simulation 
model,  gaming  facilities,  and  a  flexible  software  language  fop  developing  decision  models, 

The  oonfliot  simulation  model  would  provide  a  real  lit  to  problem  domain  for  tha  taotloal  C2  system, 
much  the  same  as  provided  with  TALON  or  TAC  ASSESSOR.  The  conflict  simulation  model  would  perform  the 
general  combat  accounting  funotions  necessary  to  keep  track  of  loglatlos,  movement,  and  attrition 
aspects  of  the  air  and  ground  operations.  An  air  and  ground  C2  atruoture  would  overlay  this  oonfliot 
model;  however,  the  internal  operations  of  each  C2  element  would  not  be  rigidly  specified.  In  faot, 
esoh  C2  element  would  be  designed  to  a^ept  either  human  gamers  or  oomputer  soienoe  models  for 
representing  its  internal  funotiona. 

By  providing  gtnsrio  C2  elements,  t-  r?  atbed  offers  the  opportunity  to  use  human  gamers  and 
oompubsr  soienoe  techniques  In  ..erative  fashion.  Human  gamers  could  be  used  to  initially 

inveatlgate  the  functions  of  a  speci»*o  C2  element.  As  more  Is  learned  about  the  decision  prooeasea 
and  hauriatics  involved,  analysts  oould  construct  realiatio  decision  models  for  the  C2  elsmsnt. 
Subsequent  simulation  exercises  would  than  raly  on  the  computer  soienoe  models  to  represent  the  C2 
element.  A  return  to  the  use  of  human  gamers  would  occur  when  the  decision  models  failed  to  provide 
robust  behavior  (under  new  combat  conditions)  or  when  the  analyst  desired  to  study  the  G2  element  in 
more  depth. 

The  iterative  use  of  human  gamers  and  oomputer  soienoe  techniques  would  systematically  evolve  a  greater 
understanding  of  the  decision  prooeasea  Involved  in  each  C2  element.  Rsqulreuents  for  gaming 

facilities  and  personnel  would  be  kept  to  a  minimum  by  foousing  their  use  in  only  one  or  two  C2 
elements  at  a  time.  The  riohness  and  fidelity  of  a  distributed  decision  system  would  be  obtained  by 
allowing  the  human  gamers  to  interaot  with  the  decision  models  provided  for  other  C2  elements  in  the 
simulation  model. 

After  several  months  of  operation,  it  is  antiolpated  that  many  of  the  lower  eohelon  C2  elements  would 
be  represented  by  fairly  robust  dasision  models,  The  degree  of  atruoture  associated  with  many  of  tha 
lower  eohelon  deaislon  prooeasea  would  facilitate  this  development,  Thu  uso  of  human  gamers  would  tend 
to  predominate  at  the  higher  echelon  C2  elements  sinos  these  decision  processes  ere  lass  obruotured. 

If  properly  constructed,  the  C2  testbed  would  meet  a  variety  of  requirements  for  both  operational  and 
analytio  communities,  For  the  operational  community,  the  C2  testbed  would  provide  a  realiatio  setting 
for  taotloal  battleataff  training  and  a  flexible  tool  for  defining  detailed  operational  requirements. 
For  the  analytio  community,  the  C2  testbed  would  provide  a  researoh  vehicle  for  investigating  C2 
functions  and  a  high  fidelity  model  for  evaluating  new  oonoepta,  procedures,  and  hardware. 

Above  all,  the  C2  testbed  would  provide  an  excellent  ooomunloation  media  between  the  operational  and 
analytio  communities.  The  oonfliot  simulation  model  would  provide  a  common  language  and  oonoeptual 
setting  for  diaouesing  C2  issues  and  exchanging  ideas.  This  potential  opportunity  for  improved 
oommunloatlon  between  operator  and  analyst  would  be  unique  and  hard  to  dupllaute  in  any  other  setting. 


A  Final  Word 

Advances  in  cognitive  soienoe  and  simulation  modeling  offer  great  potential  for  systematically 
increasing  our  understanding  of  the  human  oomponent  of  C2,  This,  in  turn,  offers  improved  tools  for 
discussing,  analysing,  and  dofinlng  the  utility  of  C2  systems  to  taotloal  combat  forces, 

Progres  will  not  be  achieved  easily,  or  by  aooldent,  Knowledge  from  several  disciplines  must  be 
organ!,  i,  synthesized,  and  integrated  in  a  program  of  applied  ret“-  vr.  :  This  crossing  or 

dlsoipllne, 'experience  boundaries  has  not  always  been  an  easy  task  fo>  >,  .nalysts.  Accordingly, 

auooess  in  this  endeavor  will  depend  as  muoh  on  philosophical  oommitment  i,.  she  researoh  as  on  a 
financial  oommitment. 
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SUMMARY 

Avionic  eimulationa  require  verification  and  validation  ao  that  the  simulation  raaulta  can  be  applied 
reliably  to  actual  avionic  systems,  This  paper  diacuaaea  software  design  methods  as  wall  as  currently 
available  automated  aids  for  verification  and  validation.  Reverification  and  revaluation  of  a  simulation 
after  changes  are  made  will  be  presented. 

Simulations  can  be  designed  for  ease  of  verification  and  validation.  Guidelines  will  be  presented  to  show 
how  simulation  software  can  be  developed  with  verification  in  mind.  The  moat  powerful  techniques  require 
additional  statements  known  as  assertions.  The  assertions  can  then  be  used  to  check  the  validity  of  the 
simulation. 

Soma  automated  verification  and  validation  tools  are  available  today,  The  appliability  of  these  tools  to 
avionic  simulations  will  be  discussed.  The  future  directions  that  are  teen  for  such  tool*  will  be 
presented, 

Finally  the  reasons  for  change  control  will  be  preaented,  end  a  solution  to  the  problem  will  be  proposed. 
Since  moat  effort  in  a  simulation  is  devoted  to  changes  for  improvement  in  the  ayatau,  it  ia  important  to 
verify  what  the  changes  affect,  Techniques  which  automatically  detect  possible  aide  effacta  due  to  e 
change  will  be  discussed. 

1.  INTRODUCTION 

Digital  simulations  of  avionic  Byatems  are  being  ueed  and  will  continue  to  be  used  to  teat  new  concept* 
and  to  subject  systems  to  test  environments  which  are  coatly  or  impractical  to  actually  usa.  Tht 
neceasity  for  digital  simulations  has  required  acceptance  of  simulation  results  which  are  produced  under 
conditions  where  previous  practical  experience  give*  little  or  no  guidance.  At  t  consequence,  simulation 
raaulta  have  been  accepted  a*  correct  when  indeed  thay  are  erroneous.  A  recant  wall  publicised  error  in  a 
simulation  of  earthquake  stresses  caused  the  shutdown  of  fiva  nuclear  power  plants  in  the  U.8.  It  ie 
conceivable  that  a  similar  error  in  an  avionic  simulation  could  result  in  a  lose  of  certification  for 
aircraft  or  avionics  equipment. 

Simulations  are  subject  to  many  sources  of  error,  Errors  can  be  made  in  the  aeeumptione  made  in  deriving 
the  model*,  in  the  hardware  on  which  the  simulation  operates,  in  the  data  provided  to  the  simulation,  and 
in  the  interpretation  of  the  results.  This  paper  i*  concerned  with  another  eource  of  error,  one  that  ia 
of  serious  concern  -  errors  in  the  digital  simulation  aoftwnre, 

These  errors  are  removed  in  a  process  called  verification  and  validation,  Thu  most  common  technlquae 
currently  used  in  verification  and  validation  are  based  on  exercising  the  complete  simulation  through  a 
large  variety  of  teat  conditions.  The  teats,  while  comprehensive,  depend  on  toe  ingenuity  of  the  teeters 
to  detect  the  errors  present  in  the  entire  eyatem.  While  the  use  of  the  complete  system  is  necessary  to 
obtain  measures  of  eyatem  performance,  there  are  certain  problems  in  using  this  approach  to  perform 
verification  and  validation.  The  primary  problem!  are: 

1,  The  verification  and  validation  tcstB  are  not  repeatable.  Another  group  of  individual*  may 
perform  a  different  set  of  teats  or  the  same  group  at  a  different  time  may  choose  another  set  of  tools, 

2,  Tho  verification  and  validation  teats  arc  performed  late  in  the  life  cycle  of  the  project.  Thi* 
results  in  costa  not  only  to  fix  the  error  but  in  costs  dun  to  the  additional  delay  in  the  project  end  due 
to  the  need  for  reteiting  whet  had  been  tested  before,  Error*  are  corrected  under  pressure  end  aide 
effects  due  to  the  changes  are  not  well  understood, 

3,  The  verification  and  validation  teste  do  not  provide  a  quantitative  measure  of  the  goodnees  of 
the  tost.  They  are  often  designed  to  find  error*  but  not  to  yie’d  a  measure  of  correctness. 

4,  Experience  has  indicated  that  errors  are  found  in  simulations  even  after  they  have  been 
thoroughly  verified  and  validated, 

Thero  ia  no  one  single  answer  or  a  complete  solution  to  this  aet  of  problems.  However  there  ia  a  set  of 
approaches,  technique*,  and  tools  which  can  help  alleviate  the  problem  as  they  exist  today.  We  expect 
these  will  be  improved  as  more  experience  and  date  ie  gathered  on  the  use  of  the  currently  available 
■olut ions . 


2.  DESIGN  ASPECTS 

A  trained  electronics  engineer  can  examine  a  radio,  a  televiaion,  a  radar,  or  a  guidance  system  end  in  a 
very  short  time  give  a  judgement  on  how  easy  it  ia  to  teat,  to  change,  or  to  maintain  compared  to  another 
design  of  the  same  system.  Any  engineer  will  agree  that  the  ability  to  test  the  ayetem  is  based  on  the 
original  design  and  results  from  early  design  decision*. 

It  has  not  been  until  recently  that  it  was  recognized  that  software  verification  end  validation  i*  also 
dependent  on  design  decieions  and  that  a  design  from  one  eource  can  be  far  easier  to  test  for  correctness 
than  another  design  that  claims  to  perform  the  same  function. 


Achieving  iimulation  aoftvara  which  ia  easier  to  varify  and  to  validate  than  tha  avaraga  ainulation  tan  ba 
dona  by  imposing  raatrictiona  during  preparation  of  tha  ainulation  aoftvara.  done  of  the  raatrictiona 
require  management  review  for  their  enforcement.  Othera  can  ba  impoeed  by  automated  technique  which 
produce  reports  on  compliance. 

An  sxample  of  eueh  a  rcatriction,  ia  tha  requirement  that  meaningful  namaa  be  uaed  auch  at  TIKI,  SPIED, 
HEIGHT  instead  of  namaa  auch  aa  XI,  X2,  X3.  We  would  not  expect  a  teat  pilot  to  be  faced  with  examining 
instrument!  which  era  not  clearly  labeled.  Likewise  we  should  not  expect  a  testin'  to  examine  a  software 
simulation  with  abstract  namaa. 

A  nice  feature  of  using  meaningful  namaa  ia  that  vary  little  computer  knowledge  ie  required  to  impoee  this 
restriction.  A  manager  can  pick  up  any  ainulation,  aak  a  prograantr  to  point  to  all  tha  variabla  namaa, 
and  givt  a  rapid  opinion  aa  to  whathar  tha  daitign  contain*  maaningful  namaa. 

Whil*  no  known  currant  software  aneiyaie  tool  yieldt  this  judgement,  one  could  envision  a  tool  which  looks 
up  all  variabla  namaa  in  a  dictionary  auch  aa  ia  uiad  in  currant  spalling  checkers  and  yields  an  index  of 
the  number  of  names  found  versus  tha  total  number  nf  names  ea  well  at  a  Hat  of  namaa  which  war*  not 
found . 

An  axcus*  which  ia  oftan  givan  for  the  ua*  of  maaninglaai  namau  it  that  tha  programming  languag*  raatricta 
nan**  to  6  characters  or  laaa.  The  use  of  auch  languag**  ahould  be  restricted  to  non-critical 
simulation*.  They  severely  impact  tha  ability  of  anyone  to  varify  and  to  validate  the  aoftwara  although 
oroaa  reference  Lists  to  maaningful  namaa  can  help  alleviate  tha  problem. 

Every  variable  uaed  in  e  digital  simulation  haa  a  finite  range.  In  the  deye  of  enelog  eimuletion  it  wet  e 
chellenge  to  scale  the  range  of  each  verible  to  the  linear  rengea  of  the  analog  devicea.  At  least  then 
checks  went  made  on  the  actual  range*  of  tha  variables  and  tha  variabla*  war*  clamped  to  maximum  or 
minimum  valuta.  Oftan  the  only  check  made  in  currant  aimulatione  ia  whan  tha  variable  overflow*  or 
undarflowa  a  computer  ragiattr.  Whan  tha  correct  rang*  of  variable'*  ia  required  to  ba  apacifitd  in  a 
daaign,  this  knowledge  can  ba  uaed  by  a  taster  to  generate  check*  and  to  genarata  reasonable  teat  date. 

A  good  design  requires  the  use  of  a  specification  which  givaa  the  maximum  and  minimum  possible  valuta  for 
each  variable  to  check  that  all  input!  and  all  output!  from  each  part  of  the  eimuletion  ere  within  the 
specified  unite. 

Every  design  engineer  ie  taught  to  use  dimensional  analyiis  to  varify  that  corraot  unite  are  used  in 
equations  end  in  conversions.  This  powerful  technique  ie  not  ueod  in  software  tutting  of  simulations. 
While  e  manual  analyeia  ie  possible,  it  can  be  tedious.  Automated  dimensional  analyais  i*  practical  and 
hae  bean  implemented  in  at  least  one  taat  tool.  It  require*  that  the  designer  apecify  the  unit*  of  each 
variable  auch  an 

VELOCITY i  REAL  UNITS  METER/SECOND j 
TIHEI  REAL  UNITS  SECOND! 

DISTANCE!  REAL  UNITS  MILE; 

METERS_TO_MILEl  REAL  UNITS  METER/MILE j 

Then  a  equation  uaed  in  a  iimulation  such  as; 

DISTANCE  t »VELOCITY<  TIMB*HETERS_TO_KILE  j 

2  METER  SECOl(D  „  METER 
MIfjE  SECOND  *  SEC0ND  *  MIlT 

can  be  checked  to  determine  that  the  units  of  distance  are  inconsistent  with  the  unite  of  velocity  times 
time  times  the  conversion  constant. 

In  a  ainulation,  software  designers  are  faced  with  at  leuet  two  different  types  of  arithmetic  in  the 
computer  program.  The  decision  of  which  type  of  arithmetic  to  appropriate  ia  a  decision  that  should  be 
made  be  the  designer.  An  example  of  what  not  to  do  in  a  simulation  is  the  following! 


An  integration  procedure  baaed  on 


x‘Ax  where  Ax«0.1 


will  result  in  a  tignificant  error  if  the  implementor  uses  steps  of  0.1  to  decide  when  to  terminate  the 
sum  instead  of  counting  the  number  of  stapa. 

Nomas  are  uaed  to  rapresent  function!,  variables,  and  constants  in  a  iimulation,  If  the  uae  of  each  name 
ia  known  to  a  verifier,  it.  can  uid  the  teatlng  process,  For  example,  if  it  ia  known  that  a  name 
represents  a  constant,  automatic  check*  ait  possible  to  determine  that  nowhere  in  the  design  ia  that  name 
assigned  another  value.  If  the  order  of  each  function  is  specified,  automatic  checks  on  the  correct  order 
of  invocation  can  be  performed.  In  addition  check*  on  whether  the  variable*  and  constants  for  a  function 
are  uaed  aa  inputa,  outputs  or  as  local  variable*  can  b*  made.  This  uae  of  names  should  be  specified  in  a 
design  aa  the  tester  or  teat  tool  can  check  whether  the  implemented  proginm  satisifea  the  design, 


o-j 


In  a  design,  it  is  a  common  practice  to  use  the  same  name  such  aa  X,  Y,  or  2  to  denote  different 

quantities.  For  example,  Z  may  at  one  time  be  the  altitude  above  ground  level  and  at  another  time  be  the 

difference  in  altitudes  between  two  aircraft.  It  ia  far  better  to  use  names  auch  aa: 

HKIGHT_ABOVi_G ROUND  and  DELTA JU.TITUDE 

Separation  of  incuts  and  outputs  in  a  design  allows  for  easier  tasting,  The  common  practice  of  using  the 
same  name  for  inputs  and  outputs  means  that  the  program  haa  a  feed  back  loop  aa  shown  in  Fig,  1, 

When  inputs  are  separated  from  outputs,  stronger  taste  can  be  applied;  and  fault  tolerance  techniques 
which  depend  on  restoring  input  values  are  made  simpler,  One  of  the  strong  tests  is  that  inputs  are  not 

altered  and  that  outputs  are  altered  only  at  interfaces.  When  the  inputs  and  outputs  are  the  same,  a 

tetter  cannot  derive  tha  response  of  the  system. 

i 

An  aid  to  a  taster  which  can  also  be  used  in  a  formal  design  review  to  aid  communication  between  system 

designsra  and  implementors  is  a  natural  language  presentation  of  the  formal  design.  Ideally  the  natural 

language  phrases  come  from  the  requirements  for  the  design.  These  phrases  are  cumbined  with  the  key  words 

of  the  programing  language  to  document  tha  design  of  the  program,  Tha  keywords  show  the  control 

structure  and  the  natural  language  shows  the  processing  and  decisions  that  are  performed, 

An  example  of  such  a  description  it: 

IF  the  aircraft  altitude  it  leas  than  100  meters 
turn  on  the  ground  proximity  butter 
END  IF 


The  keywords  IF  and  END  IF  point  out  that  a  decision  it  to  be  made.  The  natural  language  phrases  describe 
the  decision  and  subsequent  processing  in  tetma  that  are  mors  easily  understood  than  the  program  that  will 
be  implemented.  Logic  errors  can  be  caught  mors  easily  with  this  type  of  description  than  a  pure  natural 
language  description. 

Design  checks  against  a  requirement*  document  generally  are  done  vie  manual  analysis. 


3,  IMPLEMENTATION  ASPECTS 

It  it  far  easier  to  varify  a  small  simulation  than  a  large  simulation.  Tha  number  of  problama  that  must 
ba  corrected  appears  to  he  an  exponential  function  of  simulation  ties,  Although  it  is  not  wall  understood 
exactly  why  breaking  a  simulation  into  small  parts  help#  the  cite  problem,  it  ia  known  that  a  restriction 
on  tha  site  of  each  part  or  module  of  the  simulation  simplifies  the  verification  and  validation  of  the 
program. 

A  raaaonabla  restriction  on  the  module  else  appears  to  ba  the  numbsr  of  linos  that  can  be  displayed  on  the 
face  of  a  scope  or  printed  on  a  page,  When  this  restriction  ie  imposed,  tha  verification  and  validation 
of  each  module  is  simplified.  Each  module  can  be  teited  for  a  large  sol  uf  testcaaes.  While  a  larga 
simulation  cannot  be  tested  for  all  possible  combinations  of  paths  or  values,  it  may  be  feasible  to  at 
letet  exercise  each  module  individually  through  each  pith  and  for  most  input  values, 

Verification  and  validation  is  also  sided  by  the  uee  of  simple  control  ecructures  initesd  of  complex 
control  structural.  It  has  bean  shown  that  only  three  kinds  of  control  structures  are  necessary'  to  write 
any  computer  program,  that  lest  time  is  required  to  write,  to  tost,  and  to  maintain  a  program  using  simple 
control  etructurea  and  the  use  of  such  techniques  is  considered  a  substitute  for  flowcharts.  However,  in 
che  absence  of  an  automated  tool  to  teat  whether  structured  control  constructs  have  been  used,  a  visual 
inspection  of  the  flowcharts  can  verify  that  the  simulation  stiucture  is  correct  such  si  shown  in  Fig.  7. 

Even  a  small  module  can  contain  an  unnecessary  number  of  patha.  Each  unnecessary  test  adds  greatly  to  the 

u 

testing  effort  since  complete  testing  is  proportional  t.D  2  where  N  ie  the  number  of  decision  points. 
Reorganisation  of  the  implementation  can  often  reduce  the  number  of  decisions, 

Data  structnrea  can  dramatically  affect  the  algorithm  that  is  needed  to  operate  on  the  data.  Algorithms 
exist  which  can  reduce  the  complexity  and  efficiency  of  a  simulation.  Sines  an  efficient  algorithm  allows 
more  test  cases  to  b«  used,  the  viriout  date  strucures  available  for  data  rsprsaentstion  should  be  traded 
off  during  iraplemontst ion.  The  trade  off  ehould  consider  program  sir.e,  number  of  decisions,  and  execution 
time.  These  all  effect  the  verification  of  the  program. 

On  the  other  hand,  while  data  structures  are  powerful  simplifiers  in  a  program  they  introduce  potential 
sources  of  error  for  s  verifier.  The  data  structures  must  be  protected  from  illegal  accass.  The  bast  way 
found  to  provide  this  protection  i*  define  a  small  library  of  well  teated  functions  which  can  test  for 
correct  sccenes  as  veil  as  provide  access.  Access  to  data  structures  should  be  by  single  integer 
variables  or  constants,  never  by  expressions. 

Particular  attention  should  be  paid  to  loop  structure.  The  best  type  of  loop  is  one  which  computes  a 
fixed  number  of  iterations.  If  this  is  done,  infinite  loop*  ere  prevented,  Within  loops,  it  is  bast  to 
have  as  few  decisions  ee  ponible  oince  loops  have  the  effect  of  multiplying  the  number  of  paths  in  tha 
program, 

Thus  it  it  beet  for  verification  purposes  to  iterate  a  series  expression  100  times  instead  of  iterating  it 
a  variable  number  of  times  based  on  the  truncation  error.  Also  loops  should  count  using  integer 
arithmetic  instead  of  floating  point  arithmetic  to  avoid  erroneoua  count*  based  on  approximsta  arithmetic. 

A  good  practice  for  all  programs  is  to  declare  all  variables,  and  the  types  of  all  variables.  A  method  or 
tool  should  check  that  all  variables  are  used  and  that  the  types  are  not  mixed  in  expressions,  across 


modules,  or  across  statements.  Theta  practical  known  at  strong  typing  prevent  unexpected  errort  due  to 
data  type  conversion*  or  incorrect  data  repreaentation.  Toota  exist  which  can  check  that  theae  kinds  of 
errort  ere  not  present . 

A  significant  problem  area  in  simulations  ia  the  part  that  performs  input  and  output.  Although  not  a 
solution  to  the  problem,  isolation  of  the  placet  that  perform  input  and  output  to  a  small  number  aids 
verification  and  validation.  It  allows  this  potential  problem  area  to  be  tested  eaparateiy  and  if  the 
machine,  language  dialect,  or  operating  system  ia  changed,  the  modules  which  will  be  most  affected  will  be 
known.  Toole  presently  exist  which  pinpoint  where  input  and  output  art  performed, 

Miseing  initialixctiona  are  a  coboh  aource  of  error.  Explicit  initialisation  of  all  variable*  known 
throughout  the  simulation  should  be  performtd  in  a  special  module.  Variables  known  in  just  on*  module 
should  bo  initialised  by  that  module.  Tools  art  available  to  perform  this  checking,  but  explicit 
initialisation  at  designated  point*  is  superior  for  understanding  by  the  tester'.  " 


4.  AUTOMATED  AIDS 

Automated  aids  are  available  to  automatically  provide  verification  and  validation  for  programs  written  in 
several  of  the  common  programing  language*!  FORTRAN,  JOVIAL,  and  PASCAL,  Future  aids  will  be  developed 
for  COBOL  and  ADA,  Tools  that  era  currently  available  can  provide  for  static  analysis,  dynamic  tnalytia, 
and  configuration  control  of  very  large  simulations. 

Static  analysis  ia  provided  in  automated  aids  to  check  for  common  progretmaing  errors  without  requiring 
program  execution.  In  a  language  such  aa  FORTRAN  which  performs  few  check*  on  data  types  and  modules, 
static  analysis  it  extremely  valuable  in  detecting  errors  which  compilers  do  not  locate.  Even  in  a 
language  such  aa  PASCAL  or  ADA,  many  of  the  verification  teats  are  useful. 

An  example  of  a  static  analysis  technique  which  la  useful  in  any  of  the  current  languages  ia  aet/use 
analysis.  This  analysis  ensures  that  all  variables  art  set  before  use  and  that  all  variables  are  used 
after  being  set.  Sat/ua*  analysis  detects  uninitialised  variables,  dead  variables,  and  miepelled 
variables.  A  vary  large  number  of  errors  can  b*  detected  by  this  technique.  From  13— 25X  of  all  semantic 
errort  art  due  to  this  simple  misusage  of  variables,  especially  in  programs  which  use  a  large  global 
database. 

Another  static  analysis  technique  which  can  be  applied  to  simulations  written  in  any  of  the  common  high 
level  language*  ia  loop  analyait.  Loop  analysis  can  detect  certain  clasaat  of  infinite  loops.  This 
analysis  uaas  a  combination  of  graph  analyait,  data  flow  analysis,  and  symbolic  execution  to  locate 
condition*  which  will  cause  improper  loop  termination. 

An  examplt  of  improper  loop  termination  it  when  *  program  does  not  alter  the  loop  control  variable  on  all 
paths.  Data  flow  analysis  of  loop  control  variables  over  all  paths  in  a  loop  can  check  automatically  for 
loop  variable  alteration. 

Another  example  of  improper  loop  termination  is  an  incorrect  loop  predicate  which  will  cause  the  loop  to 
loop  forever, 

WHILE  I>N  DO 

FLIOHT  [I] ! -DESTINATION  [I]; 

Ii-I-li 
END  WHILE; 

By  aymbolically  executing  the  loop  control  variable,  I,  on  each  path  in  the  loop  end  using  the  loop 
predicate  I>N  it  can  be  shown  that  this  loop  will  never  terminate  since  1-1/  I.  Thin  automatic  analysis 
can  be  performed  currently  for  loop  variables  which  are  altered  monotonically . 

Future  loop  analysis  may  also  include  tests  on  proper  loop  structure  such  as  requiring: 

control  variable  intialisation  before  the  loop 
control  variable  alteration  within  the  loop 
test*  on  the  control  variable  to  exit  the  loop 
and  proper  netting  of  loops, 

Mode  analysis  is  useful  in  simulation  languages  which  do  not  have  compilers  which  perform  strong  typing. 
It  ia  particularly  valuable  in  FORTRAN  since  most  FORTRAN  compilers  produce  no  warnings  about  mixed  nod* 
expressions.  It  it  alto  valuable  in  checking  for  interface  consistency  between  separately  compiled 
programs . 

Betides  node  checking,  interface  consistency  checks  which  are  powerful  are! 

checks  for  the  same  number  of  parameters  between  formal 
and  actual  parameters 

checks  for  the  input/output  consistency  between  the 
invoking  program  end  the  invoked  program 

checka  for  the  physical  unit*  conaistency  between 
the  formal  and  actual  parameters 

Interface  consistency  is  one  of  the  meet  common  problem  ereie  became  different  people  often  work  on 
different  parte  of  a  eimulation.  By  eliminating  interface  probleme  at  an  early  stage  through  static 
analysis,  the  simulator!  can  concentrate  on  the  functional  aspects  of  the  program. 


6-5 


The  functional  aspect*  of  a  simulation  must  be  verified  and  validated  by  dynamic  testing.  However  there 
are  tools  which  can  aid-  this  testing.  These  tool.i  are  designed  to  complement  the  normal  test  environment 
by  automatically  adding  probes  to  the  program. 

The  moat  common  aid  to  testing  it  the  path  teat  analyser.  This  type  of  teat  tool  puta  probea  in  a  program 
at.  decision  pointa.  Then  when  the  program  it  executed,  the  probea  collect  data  when  the  path  is  sxsoutrd, 
After  execution,  the  test  file  is  available  to  analyte  what  parts  of  Che  program  vat  executed,  how  much 
time  wet  spent  in  each  part,  and  bow  many  teat  caaea  ware  run.  Thia  can  be  done  whether  the  program 
terminates  normally  or  tot.  It  proviuea  management  with  infcrunttcn  as  to  how  throughly  a  simulation  has 
been  tatted. 

Future  path  teat  analyser*  will  provide  information  wnich  will  be  used  to  give  a  quantitative  estimate  of 
simulation  reliability.  This  will  raquirs  analysis  of  currently  collected  data  to  determine  the  number  of 
pathi  tasted  out  of  the  total  number  of  ponible  path*  and  tho  number  of  data  value*  tested  out  of  th* 
total  number  of  possible  data  vsluei, 

Another  aid  to  dynamic  testing  ia  tha  assertion  analyser.  Assertions  of  shacka  which  have  bean  placed  in 
a  simulation  auch  as 

ASSERT  HEIGHT  >  MINIMUM  ALTITUDE) 

cun  be  instrumented  so  that  assertion  violation*  cause  the  automatic  generation  of  arror  massage*.  In  the 
future,  aush  assertion!  may  be  used  for  automatic  tent  deta  generation  for  large  numbers  of  taat  case*  to 
better  validate  program. 

In  any  simulation,  changes  are  constantly  being  mode.  Any  practical  aoftwara  tool  muat  be  able  to  check 
changes  to  a  program  without  requiring  raanalysia  of  tha  entire  program.  In  addition,  tha  aid  should  also 
ba  able  to  detect  the  parte  of  the  program  that  are  affected  by  the  change  and  report  on  the  parts  that 
need  retesting. 

One  approach  to  thia  problem  stores  a  description  of  tht  interface  'f  each  part  of  the  program.  The 
interface  include*  tha  parameters,  global  variables,  and  aisartiona  on  these  variables,  Any  time  a  part 
of  the  program  i*  changed,  a  new  interface  description  for  chat  part  ia  craatad,  The  new  interface  la 
checked  for  consistency  with  the  internal  source  of  tho  changed  part  and  with  tha  othar  interface!  in  the 
ayatem. 


5.  CONCLUSION 

The  verification  and  validation  of  avionics  simulations  (tarts  with  the  doaign  of  the  simulation. 
Standard*  for  design  and  implementation  can  aid  automated  analyaia  and  eliminate  common  errors  at  ah  early 
date,  Tool*  are  currently  available  to  perform  automated  analysis  and  to  assist  program  tatting. 
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SUMMARY 

Building  ADP-s upported  Command  and  Control  informatlonsytems  (CCIS)  is  a  complex 
process  which'  needs  special  development  strategies.  One  of  the  aids  In  this  process 
is  an  experimental  CCIS,  which  helps  the  military  commander  to  understand  the  possi¬ 
bilities  of  CCIS  and  which  supports  the  dialogue  between  potential  user  and  developer. 
One  of  these  experimental  CCIS  Is  the  system  EMFIS,  which  was  developed  by  the 
Forschungslnstltut  fUr  Funk  und  Mathematik  in  cooperation  with  the  companies  Bunker 
Ramo  Corp..  and  Siemens.  The  system  was  developed  from  1969  -  1974  and  was  lately  used 
In  WINTEX/CIMEX  79  to  clarify  the  preconditions  For  the  use  of  ADP-support  In  the 
Cz-process . 


1.  INTRODUCTION 

In  this  paper  I  would  like  to 

-  state  the  problem  of  integrating  CCIS  Into  the  Cz-process 

-  say  some  words  about  feasible  strategies  to  develop  CCIS 

-  derlvate  from  the  above  the  necessity  of  experimental  CCIS  and  give  a  short  de¬ 
scription  of  the  experimental  system  EMFIS  developed  by  our  Institute 

-  describe  experiences  of  preparation  and  performance  of  a  test  in  exercise,  l.e. 
use  of  EMFIS  In  WINTEX/CIMEX  79. 


2.  INTEGRATION  OF  CCIS 
2.1  Man-Machine  Interface 

Let  me  start  with  the  conclusions  of  a  paper  presented  at  the  22nti  Commanders  Con¬ 
ference  of  the  Bundeswehr  (Eberhard,  H.,  1978); 

"When  the  military  commander  wants  to  make  effective  usa  of  technical  means,  he 
needs  a  high  sense  of  responsibility  to  use  all  possibilities  and  not  to  exceed 
the  limits.  Therefore  I  have  summarized  the  requirements,  which  derlvate  from  my 
considerations  In  the  order  I  have  stated  them. 

Of  essential  Importance  are; 

-  the  Interface  problems  need  special  attention 

the  use  of  technical  means  must  be  reasonable  and  clear 

-  training  must  lead  to  complete  control  by  the  military  user  and  overstrain  must 
be  avoided 

-  above  all  stands  the  education  to  be  a  responsible  commander. 


When  all  this  Is  taken  Into  consideration,  knowing  that  a  system  cannot  be  more 
Intelligent  than  It  was  preplanned,  bjt  that  It  can  enlarge  the  human  Intelligence, 
then  it  Is  clear  that  the  area  of  human  decisions  will  be  reserved  for  all  deter¬ 
mining  decisions  ,  all  decisions  dependent  on  situation  and  all  Improvisation. 

Therefore  I  would  like  to  complete  the  requl rement ,  that  the  military  commander 
should  first  be  trained  and  educated  to  be  a  soldier  by  the  addendum  that  the  edu¬ 
cation  to  use  and  control  the  technical  means  cannot  be  separated  from  the  military 
education." 

This  quotation  states  the  main  reasons  for  the  use  of  experimental  CCIS,  In  order  to 
avoid  malfunction  In  operational  employment: 

-  to  recognise  and  solve  Interface  problems 

-  to  demonstrate  technical  means  and  to  rouse  understanding 

-  to  serve  as  a  training  system 

-  to  prove  how  well  technical  means  can  be  Integrated  Into  the  C2-process. 

2,2  Steps  of  the  C2-process 

It  Is  advisable  to  Investigate  the  C2-process,  where  and  how  technical  means  like  an 
ADP-supported  CCIS  may  support  this  process  (Fig.  1).  There  are  various,  but  similar 
ways  to  group  the  C2-Process  by  "steps"  (Wust,  H.,  1974), 

Some  of  these  steps  can  be  totally  or  mainly  taken  over  by  an  ADP-supported  CCIS, 

e.g.  collecting  and  displaying  Information.  Other  steps  can  be  supported  by  such  a 
system  like  to  analyse  Information,  to  propose  measures,  to  Issuu  orders.  But  some  of 
these  steps  stay  mainly  or  completely  In  the  responsibility  of  the  commander  like 

evaluation  and  decision.  The  degree  of  automation  will  also  highly  depend  on  the 
mission  which  Is  supported.  The  more  predictable  the  types  of  processes  are,  the 
higher  the  degree  of  automation  will  be. 

3.  PROBLEMS  OF  DEVELOPMENT 

Besides  the  problem  of  Integrating  an  ADP-supported  CCIS  Into  the  C2-process  the 

problem  focuses  In  the  complex  process  of  developing  these  systems. 

3.1  Development  Strategies 

Several  development  strategies  were  created  in  course  of  time  (Fig.  2)  (Wagner,  K.H. 
1978).  The  first  approach  Is  the  insular  approach  which  solves  singular  problems,  so 
that  mostly  clearcut  projects  can  be  defined,  1 nterdopencles  will  be  neglected,  diffi¬ 
culties  in  competence  do  not  occur.  The  projects  are  manageable,  unalysls  is  done  for 
this  single  project  only,  times  of  development  are  relatively  short.  But  interoperabi¬ 
lity  with  other  systems  Is  normally  lacking,  integration  of  systems  mostly  impossible. 
Priorities  are  defined  by  elbows  and  not  for  tho  total  organisation. 

The  contrary  approach  Is  the  total  systems  approach  which  may  have  the  goal  of  one 
centralized  Information  system  or  a  distributed  system.  This  approach  tries  to  avoid 
the  disadvantages  of  the  insular  approach,  for  the  planned  system  should  be  optimized 
over  the  total  organisation  and  should  guarantee  Integration.  However,  this  approach 
shows  other  disadvantages  like  requiring  a  detailed  analysis  of  thB  whole  organisation 
which  either  has  to  be  done  with  an  enormous  effort  of  personnel  and  coordination,  or 
will  become  a  never  ending  task,  while  the  living  organisation  is  changing,  so  that 
the  analysis  might  be  outdated  before  the  project  is  finished. 
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The  aligned  Insular  approach  tries  to  find  compromises.  The  approach  needs  a  general 
concept  which  considers  the  financial  and  organisational  possibilities  and  states 
priorities.  This  concept  Is  based  upon  analysis  of  organisation  and  missions.  Within 
this  framework  surveyable  projects  can  be  defined  at  focal  points  of  special  need  and/ 
or  ADP-characterlstlcs.  The  Interoperability  Is  not  guaranteed  per  se,  but  can  be  con¬ 
trolled  by  the  management  which  also  has  to  direct  this  aligned  approach.  This  leads 
to  the  essential  problem  of  this  approach,  fer  It  needs  a  capable  management,  which 
controls  the  single  projects,  solves  the  Interface  problems  and  guarantees  Interopera¬ 
bility  throughout  all  competences.  Without  this  management  the  approach  will  degene¬ 
rate  to  the  former  Insular  approach  with  all  its  disadvantages. 

3.2  Systemconcepts  for  CC1S 

Sometimes  you  find  the  opinion  that  integration-  and  development  problems  can  be 
reduced  by  acquisition  of  a  proved  system  (Fig.  3).  But  they  should  consider  that 
systems  are  supposed  to  support  special  missions  and  fit  into  existing  organisations. 
When  mission  and  organisation  are  identical  or  at  least  strongly  similar  this  way  Is 
feasible,  but  In  most  of  the  cases  these  conditions  cannot  be  fulfilled.  Considering 
the  fact  that  mission  and  organisation  define  the  requirements  on  which  the  system 
concept  Is  based,  then  it  becomes  obvious  how  questionable  this  way  might  be.  Does 
this  mean  now  that  for  any  mission  and/or  any  organisation  own  ADP-supported  Informa¬ 
tion  systems  have  to  be  developed  or  Is  It  feasible  to  find  compromises? 

When  the  analysis  of  mission  and  organisation  of  A  and  B  shows  a  high  commonality 
then  It  is  feasible  to  enlarge  system  A  In  order  to  cover  tlie  requirements  of  B.  That 
Is  especially  possible  when  the  system  structure  Is  modular. 

A  further  result  of  analysis  may  be  that  mission  and/or  organisation  differ  quite  a 
lot,  but  that  certain  functions  show  common  features,  e.g.  message  hand  ling  or  graph  1- 
cal  situation  monitoring.  When  these  functions  can  be  separated  then  dedicated  systems 
can  be  developed  for  eommen  use. 

If  neither  total  system  concept  nor  the  dedicated  one  Is  feasible  or  reasonable,  then 
It  will  be  necessary  that  a  system  A  and  a  system  B  will  be  developed.  But  In  order 
to  come  to  Interoperable  systems,  a  strong  control  function  has  to  observe  and  control 
the  single  projects  and  especially  the  Interfaces. 

The  most  favourable  system  concept  In  our  opinion  Is  a  combination  of  dedicated  and 
1  nteroperabl  a  systems.  Assumed  the  analysis  shows  that  the  requirements  ha-e  special 
systemf unctl ons  In  common  like  message  handling,  graphical  display,  event  monitoring, 
data  storage,  dialog  functions  and  security  handling.  Then  It  might  be  feasible  to 
develop  a  common  operating  system  enlarged  by  these  systemfunctlon'  which  can  form 
the  nucleus  for  the  Individual  but  interoperable  sytems  for  A  and  B. 

3.3  Development  Phases. 

Normally  there  Is  no  discussion  about  the  sequence  of  development  phases,  even  when 
they  are  named  differently.  I  will  use  hore  the  officially  determined  phases  of  the 
German  MoD  ( BMV g/ St s/Org ,  1973). 

These  are  the  phases 

-  Prel iminary  Phase 
Concept  Phase 
Definition  Phase 

-  Development  Phase 
Introduction  and  Operation  Phase. 


The  figure  shows  a  linear  sequence  which  Is  feasible  for  simple  projects.  Normally 
the  development  of  ADP-supported  CCIS  Is  not  simple,  but  rather  complex,  which  makes 
feed-backs  unavoidable. 

Here  the  experimental  system  will  be  Involved,  which  should  not  only  support  the  pro¬ 
cess  of  Integration,  but  the  development  process  as  well. 

In  the  preliminary  phase  experimental  systems  may  serve  to  gain  the  understanding  and 
motivation  of  the  potential  user  and  to  make  feasibility  studies.  Before  the  final 
system  goes  Into  operation  the  experimental  system  will  serve  as  a  training  system 
and  for  test  of  the  necessary  procedural  and  organisational  rules. 

When  a  modular  extension  of  the  operational  system  Is  planned,  experiments  will  sup¬ 
port  the  integration  of  new  modules  without  disturbing  operation. 

Let  me  summarize  the  reasons  for  using  experimental  systems: 

-  they  accompany  the  development  phases 

-  they  serve  to  clarify  the  organisational  and  procedural  preconditions  for  the  use 
of  CCIS 

\ 

-  they  serve  as  training  systems  for  the  future  users 

-  they  allow  system  comparisons  and  feasibility  Investigations 

-  In  an  Interim  phase  they  may  become  operational  on  selected  areas. 

4.  DESCRIPTION  OF  THE  EHF 1S-SYSTEH 

I  would  like  to  present  now  an  example  of  an  experimental  system. 

EMFIS  Is  supposed  to  serve  as  an  experimental  Command  and  Control  Information  System 
for  the  Supreme  Command  Bundeswelir.  It  was  developed  by  the  Forschungsl  nstl  tut  flir 
Funk  und  Mathematlk  In  cooperation  with  the  companies  Bunker  Ramo  Corp.  and  Siemens. 

EMFIS  consists  of  a  system  part  which  is  user-independent,  except  that  it  was  struc¬ 
tured  to  serve  in  static  HQs,  and  of  a  user-oriented  application  model,  of  which 
several  versions  for  different  user  groups  are  existing. 

4.1  EMFIS  Systemfunctlons 

The  essential  systemfunctlons  In  EMFIS  are: 

-  the  actual  gathering  and  updating  of  data 

-  the  relatively  easy  connexion  of  files  by  predefined  transactions  started  by  the 
user 

the  dialogue  between  user  and  system,  mainly  In  parametrized  form,  with  formats  to 

be  filled  In.  This  makes  It  possible  to  have  an  extensive  check  for  errors  and 

Inconsistencies,  to  prevent  an  Incorrectness  of  the  actual  data  base.  The  parame¬ 
trized  dialogue  also  supports  the  user  In  formulating  the  updating  reports  as  well 
as  the  queries 

-  the  multiple  access  allows  to  read  end/or  write  at  the  same  date  base  from  different 
terminals.  This  makes  It  necessary  to  control  transactions  for  possible  conflicts 

-  the  data  base  recovery  by  back-up  and  restart  routines  as  well  as  system  readiness 
under  reduced  conditions 

-  access  control  which  meets  the  special  security  regulations  for  handling  classified 

material  In  the  military  area,  In  a  way  which  still  al’ows  the  necessary  flexibility 

display  of  Information  In  alphanumeric  form,  e.g.  In  tabular  form  and  In  graphical 

form  as  charts,  diagrams  and  situation  maps. 


4.2  EMFIS  application  model 


The  main  application  modal  In  EMFIS  has  the  objective  to  show  the  combat  readiness  of 
own  forces  focusing  on  crisis  and  tension.  The  combat  readiness  of  own  forces  will  be 
mainly  represented  by  tho  status  of  alert,  mobilisation,  personnel,  logistics  and  de¬ 
ployment.  This  will  cover  the  Information  requirements  of  the  Supreme  Command  Bundes- 
wehr  only  partially,  but  represents  an  essential  model  In  the  sense  of  the  experiment. 

5.  EMFIS-TEST  In  M I NTE X / C 1  ME X  79 

With  this  experimental  system  we  participated  In  WINTEX/CIMEX  79  for  a  test  under  exer¬ 
cise  conditions.  Why  was  this  participation  decided,  which  did  cost  time  and  money? 

5.1  Objectives  for  Test  In  Exercise 

The  first  reason  Is  to  Increase  the  military  (and  civilian)  user's  understand  1 ng  for 
ADP  and  CCIS.  That  Includes  the  realisation  of  the  facilities  and  limits  of  these 
technical  means,  as  well  as  the  pulling-down  of  barriers  of  non-existing  capability 
and  good-will.  In  theoretical  and  even  practical  Instructions  we  still  make  the  ex¬ 
perience  that  the  potential  users  are  still  sceptic  towards  the  "black  box  to  which 
they  do  not  want  to  surrender". 

The  Investigation  and  evaluation  of  the  technical  functions  of  a  system  towards  com¬ 
pleteness  and  effectiveness  as  well  as  Integrablllty  Into  C^-procoss  under  real 
conditions  Is  a  further  objective. 

Perhaps  the  essential  reason  Is  the  determination  of  the  preconditions  to  guarantee 
an  effective  and  smooth  performance.  These  preconditions  Include  organisation,  proce¬ 
dures  (e.g.  security  procedures),  legal  problems  (e.g,  the  privileges  of  the  PTTs) 
as  well  as  methods  and  extent  of  training  for  system  personnel  and  users. 

The  obvious  objective  Is  the  evaluation  of  Information  requirements  and  the  Implemen¬ 
tation  under  real  world  conditions. 

5.2  Exercise  Preparations 

The  preparations  started  In  summer  1978  and  lasted  till  the  last  minute!  before  begin 
of  the  exercise  in  March  1979. 

After  financing  was  clarified  based  on  the  preplanning  of  hardware  and  software  neces¬ 
sities  the  actual  preparations  could  start. 

Because  there  was  no  exercise  equipment  available,  roost  of  tho  hardware  had  to  be  pro¬ 
cured  In  and  for  a  short  time.  Procurement  of  the  central  hardware  was  no  problem, 
because  we  could  use  the  computer  of  our  Institute.  But  to  get.  the  equipment  for  the 
5  terminals  was  a  rather  big  problem,  especially  under  the  short-time  conditions.  To 
get  the  cryptographic  devices  for  the  secured  communication  linos  war.  feasible,  because 
of  an  existing  pool  In  tho  German  MoD.  But  further  more  wo  were  forced  to  rent  communi¬ 
cation  lines  from  the  German  Bundespost  who  was  not  quite  willing  t.o  switch  the  lines 
for  only  one  month. 

As  far  as  the  system  and  the  data  base  Is  concerned,  there  Is  to  say  that  we  bail  th>* 
EMFIS  system  software  available  which  Is  quite  reliable.  1o  talk  nlmui  t.  In:  a  up  I  1  c.t  t.  •  or, 
software  and  Its  preparations  Is  another  story.  There  was  a  tested  v'ftware  existing, 
hut  organisational  and  procedural  changes  In  the  area  which  should  be  sup| u-ted  made 


It  necessary  to  adept  the  programs  within  a  short  time.  In  addition  the  data  for  the 
Initial  situation  of  the  uxerclse  had  to  be  put  Into  the  data  base. 

Personnel  for  the  exercise  for  an  around-the-clock-operation  had  to  be  found  and 

trained.  Operators  came  from  an  operators  platoon  of  the  Air  Force  and  needed  only  a 
short  Instruction.  The  job  of  the  systemcontrol 1 er  was  taken  over  by  experienced 

EMFIS  specialists,  because  this  Is  an  Important  function  for  system  readiness  and 

security.  Advisers  had  the  function  to  help  the  users  at  the  terminals  In  this  first 
employment  of  the  system. 

All  these  people  had  to  be  trained  especially  systemcontrol 1 ers  and  users.  For  these 
two  groups  manuals  are  existing  which  had  to  be  updated.  The  3  systemcontrol 1 ers  had 
the  chance  to  get  trained  In  test  and  practical  Instructions.  The  training  of  the 

users  was  quite  shortcut,  consisting  of  one  theoretical  and  one  practical  instruction 
and  6  hours  pre-exercise.  But  the  manuals  and  the  first  days  of  the  exercise  helped 
them  to  get  skilled. 

There  Is  really  no  necessity  to  mention  that  security  plays  an  Important  role  In  mili¬ 
tary  systems.  All  personnel  had  to  be  adequately  cleared,  the  electronic  security  of 

the  computer  centre  of  the  Institute  had  to  be  measured  and  stated  as  well  as  the 

security  of  the  communication  lines  and  the  cryptographic  devices.  Security  procedures 
had  to  be  worked  out. 

5.3  Exercise  Hardware  Configuration 

The  exercise  hardware  configuration  (Fig,  4)  consisted  of  the  computer  of  the  Insti¬ 
tute,  a  Siemens  7.748  with  data  transmission  control.  In  the  computer  centre  there 

was  one  terminal  for  the  system  controller  with  visual  displays  unit  (VDU)  and  printer. 

Remote  terminals  were  with  user  A  and  User  B  at  the  German  MoD  In  the  first  phase  of 
the  exercise  and  In  the  bunker  of  the  government  In  the  second  phase.  User  A  had  a 
terminal  with  VDU  and  Printer,  User  B  a  terminal  with  VDU  and  teletypewriter  for  here 
a  punchtape  had  to  be  prepared  which  was  compatible  with  the  normal  Bundeswehr  tele¬ 
type  network,  so  that  orders  could  be  distributed.  The  terminals  were  connected  with 
the  Centre  by  rented  data  lines  resp.  teletypelines  secured  by  ELCROBIT  or  ELCROTEL. 
The  lines  were  rented  from  the  Bundespost  and  switched  when  the  users  moved  from  MoD 
to  headquarter. 

5.4  Exercise  Experiences 

The  main  experiences  made  In  this  test  In  exercise  can  be  summarized  as  follows: 

-  The  system  was  used  parallel  to  the  conventional  procedures,  so  that  a  comparison 
was  feasible  between  conventional  and  ADP- supported  Information  flow.  The  ADP-sup- 
ported  Information  flow  and  situation  monitoring  was  faster,  but  what  was  more 
Important,  It  was  more  precise  and  free  of  errors. 

The  time  In  which  the  user  got  accustomed  to  the  system  was  amazingly  short.  We 
think  this  was  due  to  the  formatted  Inputs  and  to  the  fact  that  the  conventional 
procedures  were  Implemented  In  the  application  software  as  much  as  possible  or 
reasonabl e. 

-  There  was  an  unexpected  high  number  of  Indirect  users,  l.e.  users  which  needed  the 
Information  as  infoees  and  which  could  better  be  supplied  than  In  a  conventional 
system. 


Especially  the  objective  to  gain  understanding  for  the  use  of  ADP-supported  CC1S 
could  be  readied  because  there  were  opportunities  to  demonstrate  such  a  system 
under  real  conditions  to  several  groups  of  visitors. 


-  Hard-  and  Software  worked  well  through  the  whole  exercise. 

-  The  systemfunctlons  of  EMFIS  proved  reasonable,  especially  that  of  the  systemcon* 
troller,  l.e.  to  have  human  function  highly  computer-assisted  to  control  system 
readiness  and  data  security. 

-  Negative  experience  was  the  quality  and  stability  of  the  communication  lines  which 
we  got  from  the  Bundespost.  This  escalated  up  to  complete  destroy  of  a  line  by 
road  construction.  The  best  ADP-supported  CCIS  Is  only  as  good  as  its  communication 
lines.  Positive  result  of  this  was  the  flexible  reaction  of  the  system  EMFIS 
towards  these  malfunctions. 

-  The  test  has  ensured  our  conclusion  that  application  software  adapted  to  the  C2- 
prucess  needs  continuous  maintenance,  because  any  change  in  organisation  or  proce¬ 
dures  has  an  Impact  upon  software.  But  only  this  way  allows  an  effective  support 
to  the  C^. process. 


6 .  CONCLUSIONS 

I  have  started  this  paper  In  quoting  some  conclusions  about  man-machine  Interface  In 
C2-process  and  would  like  to  extend  these  conclusions  by  my  own. 

-  The  support  of  the  C2-process  by  computer  is  a  complex  problem,  which  leads  to  a 
complex  development  process.  This  makes  a  continuous  dialogue  between  user  and 
developer  necessary. 

-  In  order  to  break  the  complex  process  down  to  reasonable  development  steps,  It  Is 
necessary  to  have  a  long-term  concept  but  a  short-term,  step-wise,  modular  Imple¬ 
mentation. 

Orly  pragmatic  proceeding  rouses  understanding  and  motivation  of  the  military  com- 
ancer. 

-  The  development  of  ADP-supported  CCIS  Is  connected  with  the  development  of  adequate 
communication  systems.  But  do  not  forget  to  consider  that  In  the  past  communication- 
systems  were  rather  determined  by  engineering  progress  and  were  offered  to  the 
military  commander,  whereas  the  development  of  CCIS  should  be  marked  by  the  fact, 
that  It  needs  the  close  cooperation  with  the  military  commander. 

All  people  working  In  the  development  of  ADP-supported  CCIS  sometimes  come  to  the  con¬ 
clusion  that  It  Is  a  nearly  unsolvable  task.  But  the  dBluge  of  Information  as  well  as 
the  fact  that  reaction  time  becomes  shorter  and  shorter,  force  us  to  find  the  right 
way  to  solve  these  problems. 
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SUMMARY 


The  scope  of  studies  and  simulation  techniques  in  the  area  of  Air  Defense  (A/D)  broadly 
reaches  from  detailed  teohnioal  simulations  of  system  components  (e.g.  radar  detection, 
missile  flyout,  aircraft  vulnerability)  up  to  theater  level  air  defenee  war  gamee.  Only 
few  activities  are  known  which  try  to  comprehensively  include  Early  Warning  and  Command 
&  Control  (EW/C2)  into  closed  operations  analysis  type  air  defense  simulation  models. 

This  paper  describes  the  achievements  of  a  study  which  is  tasked  to  provide  a  computer 
model  that  quantifies  the  effect  of  EW/C2  in  terms  of  active  air  defense  Measures  of 
Effectiveness  (MOEs) . 

The  model  discussed  includes  the  main  technical  and  operational  procedures  which  will  be 
followed  in  air  defense  in  case  of  an  air  attack 

.  information  acquisition  on  hostile  targets  and  counter  weapons 

.  evaluation  of  the  tactical  situation (b) 

(air  picture  and  own  status) 

.  weapons  allocation  decision (s)  and  control 
.  evaluation  of  results. 

The  model  is  rather  aggregated,  highly  input  oriented,  independent  of  specific  systems 
and  doctrines  and  thus  offers  flexibility  of  application  to  various  teohnioal  and  opera¬ 
tional  questions.  The  development  status  of  the  models  is  discussed  as  well  as  the  main 
problems  faced  during  the  design  and  those  still  ahead. 


1 .  GENERAL  SITUATION 

1 . 1  History 

The  core  effort  of  analysis  as  described  in  the  context  of  this  paper  is  the  development 
of  aomputer  models  to  simulate  the  operational  and  teohnioal  behaviour  of  air  defense 
aommand  &  control  systems.  With  respect  to  brevity,  emphasis  in  this  paper  is  oonoentrated 
on  the  operations  analysis  part  of  the  described  task.  Development  and  application  of 
toolB  for  the  evaluation  of  technical  feasibility  of  systems  or  systems  components  and 
for  the  generation  of  input  data  for  the  OR-Model  are  running  in  parallel  with  comparable 
endeavor.  The  history  of  operations  analysis  and  research  demonstrates  a  slow  but  con¬ 
tinuous  progress  towards  the  modelling  of  more  and  more  complex  systems,  system  mixes 
and  system  structures  of  highly  interdependent  individual  Bystem  units.  The  basic  steps 
which  were  passed  throughout  the  last  10  to  15  years  can  be  summarized  by 

.  models  for  individual  systems 

(1  on  1  or  one  on  few  engagement  models) 

.  models  for  multiple  systems 

.  models  for  system  mixes 

.  theater  level  models  including  weapon  systems  and  command  &  control  systems  and  their 
interactions . 

Fig.  1  tries  to  give  a  qualitative  indication  on  the  increasing  complexity  of  the  problems 
and  associated  models. 

Numerous  models  have  been  developed  providing  adequate  tools  for  the  preparation  of 
decision  support  at  the  various  stages  of  the  development  and  procurement  process  of 
materiel,  with  one  major  exception,  which  is  the  integration  of  command  n  control  into 
a  "closed  simulation".  Several  problems  have  been  faced  which  dieoourage  us  from  under¬ 
taking  this  effort! 

.  Complexity! 

The  complexity  of  a  systum  such  as  the  Integrated  Air  Defense  and  the  impact  of  C *  are 
not  well  enough  understood  by  analysts. 

.  Uncertainty! 

The  uncertainty  about  the  commander's  decisions  cannot  be  modelled. 

.  Significance!! 

The  question  whether  or  not  results  of  a  "Command  s  Control  Model"  will  be  significant 
with  respect  co  the  uncertainties  named  above  can  only  be  answered  by  experimenting 
with  such  a  model. 


.  Measures  of  Effectiveness  (MOB) : 

Simple  MOEs  (e.g.  averaged  radar  ranges)  are  not  adequate  co  evaluate  the  effectiveness 
of  Early  warning  and  C2.  Complex  MOEs  (e.g.  contribution  of  C2  to  the  number  of  hostile 
targets  killed  and  to  the  number  of  own  assets  surviving)  require  the  inclusion  of  all 
A/o  elements  and  their  interactions,  which  leads  to  extremely  large  and  expensive  models 

.  Theory: 

There  is  no  theoretical  basis  available  on  Early  Warning  and  Command  i  Control. 

.  Resources:  . 

Leak  of  computer  resources  prohibited  models  of  size  and  complexity  adequate  to  the  Cr 
problem, 

A  study  of  this  complexity  offers  a  relatively  high  risk  with  regard  to  cost  and 
success. 

.  Study  Policy: 

A  study  which  ultimately  quantifies  the  effect  of  command  t  control  might  question  the 
benefit  of  existing  or  planned  systems  and  the  validity  of  existing  C2  doctrines. 

1.2  At  Present 

Only  few  activities  have  been  recognized  which  try  to  provide  quantitative  measurement 
of  air  defense  command  &  control  effects.  However,  the  time  appBai'B  to  be  mature  for  this 
step  forward. 

.  Extensive  on  going  and  past  weapon  system  analyses  provide  a  sound  data  baso  and  good 
experience  for  the  engagement  part  of  an  overall  air  defense  model. 

.  Size  and  speed  of  computers  available  promise  economic  handling  of  complex  problems. 

.  Increasing  expenses  in  the  air  defense  EW/C2  area  more  than  aver  demand  the  quantitative 
proof  of  the  effectiveness  of  those  systems. 


1  . 3  Outlook 

The  study  activity  presented  in  this  paper  is  a  promising  approach  to  simulate  the 
integrated  air  defense  within  one  solf  contained  simulation  model.  It  will  include  all 
basia  components  of  ground  based  and  airborne  weapon  systems  and  EW/C2  systems  und 
functions.  A  first  version  of  the  model  is  presently  in  the  final  development  phase. 

2.  Discussion  OF  THE  PROBLEM 

2.1  Measures  of  Effectiveness  (MOEs) 

The  keys  to  the  structure  of  any  OR-Model  ultimately  are  the  degree  of  detail  desired  and 
the  measures  of  ef feotiveness  to  be  used,  For  complex  systems,  however,  one  MOE  only  will 
not  be  adequate  to  answer  all  potential  questions  to  be  investigated.  In  our  case,  the 
MOE(s)  must  serve  the  purpose  to  measure  the  effectiveness  of  EW/C2  in  terms  of  ths 
effects  on  air  defense  performance.  Frequently  used  terms  such  as  radar  ranges,  track 
quality,  completeness  of  the  air  picture,  reaction  times,  etc.  can  be  used  to  analyze  and 
optimize  subsystems,  as  these  MOEs  express  the  performance  of  components,  however,  they 
do  not  measure  the  effectiveness  of  the  total  system.  As  for  the  latter  the  olassioal 
MOEs  for  air  defense  can  be  applied: 

.  number  of  hostile  targets  killed,  total  and  by  target  type 
.  number  or  probability  of  own  air  defenses  and  assets  killed 
.  number  of  red  and  blue  weapons  expended,  by  target  type 
.  number  of  uneffeotive  engagements;  reasons  for  failure,  etc. 

For  complex  problems  more  than  one  MOE  must  be  applied  in  order  to  gain  a  complete  picture 
of  the  effectiveness,  and  the  problem  remains  usually  with  the  customer,  how  to  combine 
these  results  to  higher  aggregated  numbers  or  decision  variables.  E.g.  killed  A/C  are 
hardly  comparable  to  the  tactical  value  of  surviving  command  posts.  Even  higher  aggregated 
and  more  pretentious  MOEs  can  be  defined  such  as: 

.  endurance  of  a  defined  minimum  air  defense  power  over  a  certain  time  period 
.  contribution  of  air  defense  C  to  the  FEBA  movement 
•  deterrence  effects. 

To  find  numbers  for  this  kind  of  parameters,  however,  is  either  impossible  or  requires 
extensive  and  extremely  sophisticated  and  expensive  war  gaming  techniques.  A  closed 
simulation,  thus,  will  be  restricted  to  a  selection  of  those  "classical”  MOEs  for  air 
defense  as  listed  above  (killed  A/C  etc.).  If,  however,  a  simulation  model,  including 
command  &  control,  can  provide  a  quantitative  measurement  of  the  effectiveness  of  C2  by 
these  MOEs  this  can  indeed  be  considered  a  step  forward  in  analytical  evaluation 
techniques  for  military  systems. 
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Above  that  it  seems  to  be  impossible  to  define  the  "ultimate  purpose"  of  the  C  system, 
yet,  the  ultimate  purpose  might  vary  from  one  conflict  type  to  another. 

This  leads  to  the  discussion  of  some  critical  points  in  the  task  of  modelling  air  defense 


2.2 


Specific  Problems  and  Restrictions 


Although  the  conditions  as  they  developed  throughout  the  last  years  are  promising  with 
respect  to  C2  modelling,  some  major  problems  still  have  to  be  analyzed  and  understood. 

A  first  "Integrated  Air  Defense  Simulation"  will  still  suffer  from  some  shortcomings  and 
restrictions  since  the  task  has  to  concentrate  first  of  all  on  the  overall  structuring 
of  the  problem  and  on  the  basic  approach  rather  than  to  try  perfection  at  each  individual 
module. 

2 

It  was  well  understood,  that  there  was  no  exact  definition  of  air  defense  C  available 
whioh  could  be  taken  aa  a  baseline  for  the  approaoh.  As  will  be  explained  later  in  more 
detail,  the  methodology  developed  is  a  rather  pragmatic  sequonceing  of  the  major  technical 
and  operational  functions  of  air  defense  and  its  C2,  which  are  supposed  to  be: 

.  surveillance/target  detection 
.  aquisition  and  update  of  target  information 
.  processing  and  distribution  of  air  picture  data 
.  analysis  and  evaluation  of  the  threat 

.  monitoring  and  evaluation  of  the  status  of  own  air  defense  systems 
.  alerting  of  air  defense  systems 

.  allocation  and  coordination  of  weapon  systems  engagement 
.  monitoring  and  evaluation  of  engagement  reaultB  and  consequences. 

Thie  approach,  consequently,  excludes  the  simulation  of  high  level  political  and  strategic 
decisions.  They  will  be  merely  regarded  via  input  such  as  status  files,  weapon  resources 
available,  etc.  at  the  beginning  of  an  anticipated  conflict. 


The  simulated  time  slice  of  a  conflict  must  be  limited  to  an  Interval  whioh  bIIowb 
redeployment  and  reorganizing  of  the  air  defense  resources  off  line  between  individual 
computer  simulations.  This  ia  necessary,  as  no  dynamic  redeployment  algorithm  could  be 
developed  up  to  now. 

There  is  almost  no  value  in  modelling  air  defense  without  including  at  least  the  basic 
types  of  countermeasures .  However,  the  step  from  benign  to  an  even  rather  simple  ECM 
environment  considerably  increases  the  complexity  of  the  model  and  the  cost  and  manpower 
involved.  Simulation  of  an  ECM  scenario  may  multiply  the  number  of  computer  statements 
to  be  executed  by  a  factor  of  10  to  50  as  compared  to  a  benign  environment. 


A  similar  degree  of  complexity  offers  the  IFF  problem.  Neither  theoretical  nor  experimen¬ 
tal  data  are  available  on  the  reliability  and  the  dynamics  of  future  IFF  systems  when 
operating  in  dense  scenarios  including  ECM.  The  approach  to  the  IFF  proaoss  in 
theater  level  air  defense  models  is  necessarily  rather  simplistic.  The  logic  of  threat 
evaluation  and  hostile  target  classification  will  be  explained  later  in  the  course  of 
the  model  discussion. 

Another  uncertainty  which  has  to  be  faced  is  the  high  degree  of  freedom  vested  in  the 
commander  during  the  evaluation  of  tactical  situations  and  at  the  events  of  decisions: 
Only  preprogrammed  decision  choices  can  help  to  reduce  the  variety  of  possibilities. 

It  is,  however,  hardly  impossible  to  define  a  priori  effective  doctrines  for  future 
weapons  and  C2  systems,  whose  technical  and  operational  characteristics  may  differ 
considerably  from  those  in  use  today.  Only  a  qualified  judgement  together  with  iterative 
or  interactive  use  of  the  simulation  wi 11  lead  to  a  limited  set  of  doctrines  correspon¬ 
ding  to  future  systems. 


3.  THE  MODEL 

3.1  Basic  Principles 

A  variety  of  technical  and  operational  functions  of  an  EW  and  C.'2  system  can  be  subject  to 
evaluation.  Some  examples  of  evaluation  at  the  "information  acquisition  level"  are: 

.  performance  of  alternate  sensors 
.  capacity  of  data  links 

.  degree  of  integration  or  netting  of  individual  sites  etc. 

on  the  .level  of  "information  analysis  end  utilization"  other  evaluation  areas  are  of 
interest,  such  as: 

.  logic  of  threat  evaluation 
,  alerting  procedures 

.  doctrines  of  engagement  coordination  etc. 

Many  more  subjects  can  be  defined  as  will  be  seen  later.  In  the  sense  of  evaluation, 
common  to  all  of  these  -  very  different  -  elements  is  the  demand  to  be  ultimately 
measured  in  one  or  few  terms  of  air  defense  effectiveness  equivalents. 


Th.1  a  postulates  a  highly  flexible  computer  simulation  tool  which  must  follow  some  basic 
principles : 

Independence 

The  overall  model  ae  well  as  its  subparts  must  not  be  tailored  towards  specific  systems 
In  the  sense  of  systems  hardware  and  software  nor  with  respect  to  rules  and  doctrines. 

None  of  those  will  be  "hard  wired"  in  the  model. 

Completeness 

Ae  already  mentioned  before,  the  model  must  be  capable  to  simulate  and  evaluate  all 
important  components  of  air  defense  C2  and  leave  the  actual  application  to  the  choioe  of 
the  user.  The  same  principle  applies  to  the  output  parameters. 

Flexibility 

The  model  must  be  capable  to  simulate  mixes  of  different  land  based  and  airborne  weapon 
and  C2  systems,  including  their  interconnections  and  interactions. 

Size 

Only  the  simulation  of  rather  large  and  complex  scenarios  is  adequate  to  the  evaluation  of 
Air  Defense  C2  systems. 

Consistency 

The  individual  modules  of  the  model  must  be  of  balanced  resolution.  Only  for  special 
purposes  a  program  module  with  a  degree  of  detail  higher  (or  lower)  than  the  remaining 
parts  should  be  inserted. 

Handling 

Input  and  output  of  the  model  must  be  easily  changeable  in  order  to  allow  quick  variations 
of  the  simulated  systems,  scenarios  and  doctrines.  The  turnaround  (generation  of  input, 
computer  run,  evaluation  of  results)  must  be  short  and  sufficient  numbers  of  statistical 
replications  must  be  produced  at  reasonable  cost. 

An  experienced  defense  analyst  giving  a  first  judgement  to  these  postulationB  will  con¬ 
clude  that  at  least  some  of  them  are  contradicting  or  even  excluding  each  other.  The  key, 
however,  to  the  compromise  of  a  first  approach  is  to  limit  the  complexity  Of  the  "inte¬ 
grated  model"  and  to  strictly  separate  between  thiB  model  and  the  resources  and  models 
required  to  generate  the  input  data. 

By  the  way  -  the  complexity  of  the  overall  task  requires  a  rather  heterogeneous  team  of 
analysts  of  very  different  disciplines.  Hence  it  1b  sometimes  more  difficult  to  force  the 
study  team  members  to  stick  to  the  principles  of  the  approach  rather  than  to  define  the 
model  itself  along  the  lines  of  these  principles. 

3.2  The  Model  Structure 

The  overall  model  structure  follows  the  lines  of  the  "classical"  functional  process  of 
air  defense  operations  consisting  of  the  three  main  blockB  (see  fig.  2) ■ 

.  air  situation 
.  allocation 
.  engagement . 

In  figs.  3  and  4  the  blocks  of  air  situation  and  allocation,  respectively,  are  broken 
down  into  their  program  modules  each  of  which  is  representing  a  major  function  within  the 
air  defense  EW  and  C2  system. 

These  individual  submodels  are  controlled  by  a  general  frame  program.  It  exclusively 
executes  organizational  tasks.  It  provides  input  routines,  output  monitors  and  data 
management  service,  and  the  control  of  the  individual  submodels. 

Regarding  the  variety  of  air  defense  C2  systems  and  the  different  nature  of  their  sub¬ 
systems  to  be  included  in  one  model,  the  control  of  each  of  the  submodels  was  decided  to 
be  optionally  either  strictly  time  step  oriented,  event  oriented  or  mixed  mode. 

This  allows  the  realietic  and  economic  simulation  of  periodic  processes  (e.g.  radar 
rotation,  cyclic  data  transfer)  sb  well  as  asynchronous  events  such  as  engagements  and 
kills,  waiting  queues,  etc.  The  internal  feedbaok  loops  of  the  model  are  not  shown  in 
the  figures. 

Returning  to  figs.  3  and  4  the  following  chapters  give  a  short  description  of  the  model 
nodules  (left  hand  column  in  figs.  ^  and  4)  and  the  associated  typeB  of  input  data  and 
methods  of  input  generation  (right  hand  column) . 

3.2.1  The  Scenario 

The  Red  scenario  is  composed  of  up  to  250  "flights"  of  targctB  which  can  be  either  single 
A/C  or  formation  targets.  Each  flightpath  is  a  polygon  of  legs  with  variable  flight 
parameters  (altitude,  heading, velocity  etc.)  per  leg.  A/C  or  formations  are  further 
characterized  by  their  radar  cross  section, number  of  A/C, and  jamming  status  (ESJ  and  SSJ) . 
In  addition,  racotrackB  of  stand  off  jammers  (SOJs) ,  ground  based  jammers,  and  chaff 
areaB  can  be  deployed. 

On  the  Blue  side,  up  to  30  ground  based  Early  Warning  radars  and  5  flight  patterns  of 
Airborne  Early  Warning  radars  can  be  simulated.  Each  of  the  radars  Is  usually  but  not 
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necessarily. co-deployed  with  a  C2  site.  Data  processing  capacities  and  communication 
networks  between  EW/C2  sites  themselves  and  C*  to  weapon  systems  communications  facilities 
and  their  capacities  are  defined  by  input.  Certain  areas  of  responsibility  for  track 
maintenance  and  crosstell  -  so  called  track  production  areas  and  track  continuity  areas  - 
are  assigned  to  each  site. 

The  terrain  model  is  based  upon  probability  distributions  of  target  unmask  ranges  as  e. 
function  of  target  altitude.  Different  distributions  oan  be  input  depending  on  the 
category  (rough,  flat  etc.)  of  terrain  surrounding  the  site. 

The  Slue  air  defense  weapon  systems  -  the  various  classes  of  ground  based  air  defense 
systems,  and  fighter  units  -  are  characterizes  by  their  deployment,  the  readiness  status, 
tne  control  state,  and  by  their  performance  data  as  far  as  required  for  the  weapons 
allocation  process. 

3.2.2  Target  detection 

Depending  on  the  actual  application  task,  the  deteotion  can  be  simulated  in  two 
optional  ways  which  substantially  differ  by  the  degree  of  detailt 

Both,  the  "Multi  Radar  Model"  as  well  as  the  "Simplified  detection  by  Area"  can  be  run  on¬ 
line  within  the  overall  simulation. 

The  Multi  Radar  Model  uses  the  detailed  technical  data  of  the  radars  and  calculates  the 
physical  deteotion  process  (signal  to  interference  ratio)  of  eaoh  individual  target 
regarding  the  target  data  and  its  electronic  and  geographic  environment.  The  output  is 
basically  the  single  scan  detection  probability  and  target  resolution  status. 

As  they  include  the  physical  effects  of  main  beam  and  sidelobe  interference  of  active 
jammers,  clutter  and  chaff  effects  and  the  accuraoy  of  measurement,  those  results  are  rather 
exact  and  realistic,  however,  at  the  priae  of  relatively  high  computer  cost. 

The  detection  by  area  assumes  that  in  specific  environmental  areas,  e.g.  in  the  foreground 
of  chaff,  within  the  spoke  of  an  SOJ  etc.  the  average  detection  probability  by  radar  can 
be  expressed  as  a  function  of  target  radar  cross  section,  its  distance  to  the  radar,  its 
altitude,  and  a  few  other  target  and  radar  parameters. 

These  parametric  data  of  single  scan  detection  probabilities  are  precalculated  by  the  de¬ 
tailed  radar  model  for  those  parameter  combinations  which  actually  occur  in  the  scenario. 
Detection  probability  envelopes  calculated  for  test  scenarios  proved  this  approach  to  be 
feasible  (see  fig.  5). 

This  method  allows  the  precalculation  of  the  history  of  intersections  of  the  flight  paths 
with  the  boundaries  of  the  different  deteotion  areas  in  advance  of  the  combat  simulation 
for  eaoh  target  versus  each  radar  (see  fig.  6) .  The  deteotion  simulation  itself  is 
reduced  simply  to  finding  out  the  actual  set  of  parameters  for  the  simulated  point  in 
time  and  for  each  radar/target  combination  and  to  drawing  a  random  number  against  the 
corresponding  detection  probability. 

Jamming  targetB,  when  covering  the  radar's  frequency  band  generate  a  jammer  strobe  as 
soon  as  they  are  in  radar-line  of  sight  and  as  long  as  burnthrough  cannot  be  achieved  by 
the  radar.  The  strobes  are  maintained  in  the  Htrobe  file  for  further  processing. 

3.2.3  Tracking 

The  tracking  model  ia  a  fast  running  tracker  which  includes  all  degrees  of  freedom  of 
real  tracking  logics  with  the  exception  of  the  detailed  mathematics  of  the  filtering 
process.  Implementation  of  filters  into  such  a  model  is  not  proposed  for  two  reasons. 

First  of  all,  the  flightpath  input  data  do  net  describe  the  target  trajectories  in 
sufficient  detail  and  secondly,  modelling  of  filters  would  exceed  the  desired  grain  of 
the  overall  model.  Similar  to  the  principle  applied  to  the  simplified  detection  simu¬ 
lation,  the  filter  performance  will  be  regarded  by  so  called  reduction  factors  which 
are  calculated  off  line  by  detailed  programs  representing  the  tracking  logic  of  the  real 
systems  to  be  investigated. 

Input  to  the  traaking  model  is  the  sequence  of  target  plots  per  radar  and  target  as 
generated  by  the  detection  model.  The  type  of  trac1';  initiation  and  track  maintenance/ 
track  quality  calculation  logic  can  be  specified  by  input. 

As  the  result  the  bo  called  track  quality  matrix  specifies  for  each  tracking  site,  which 
target  is  in  the  initiation  process  or  in  the  system  track  file  and  which  quality  is 
assigned  to  it  at  the  simulated  point  in  time. 

3.2.4  Data  Processing  (DP)  and  Data  Communication  (DC) 

The  task  of  this  modal  is  to  simulate  the  behavior  of  data  processing  and  communications 
equipment.  The  network  of  C2  systems  is  specified  by  the  so  called  communication  matrix 
and  its  associated  link  and  data  processing  capacities.  The  data  generated  by  the 
detection  and  tracking  model  Is  transformed  into  the  workload  of  the  communication  net 
and  its  processing  centers  which  requires  further  information  on  message  lengths,  over¬ 
head  procedures,  processing  times  per  trnck  etc. ,  which  have  to  be  provided  to  the  model 
from  off  line  analysis  or  -  whan  available  -  by  measurements  at  the  Bystems  considered. 


The  dp  and  DC  models  are  processing  the  following  types  of  information  or  messages! 

.  system  tracks 

.  tracks  in  the  initiation  process 
.  strobe  tracks 

.  crosatell  inputs  and  outputs 

(ground  to  ground,  ground  to  air,  air  to  ground) 

.  C2  messages 
.  overhead  factors 

.  basic  load  profile  for  messagas/prooeasas  other  than  those  above 

The  DC  part  of  the  model  periodically  simulates  the  time  delays  and  information  losses 
occurring  in  the  croastell  network  by  a '.queueing  and  filtering  logic.  Main  emphasis  is 
paid  to  the  track  data  crosstell  and  the  update  process  of  the  air  picture  at  the  sitee 
participating  in  the  network. 

For  each  processing  cycle,  the  DP  model  accumulate#  the  actual  workload  generated  by  the 
elements  listed  above.  From  the  past  and  momentary  load  of  the  processing  units,  delay 
times  particularly  those  of  the  air  picture  data  are  determined. 

The  DP/DC  model  finally  delivers  the  air  piature  as  it  develops  in  all  sites  and  canters 
of  the  EW/C2  system  simulated. 

3.2.5  Jammer  Strobe  Processing 

At  present,  the  strobe  tracks  are  maintained  as  part  of  the  air  picture  file.  Sophisti¬ 
cated  techniques  for  ranging  the  jammers  such  as  triangulation  and  correlation  procedures 
cannot  be  modelled  yet,  since  no  sufficient  experimental  nor  theoretical  experience  is 
available  about  this  problem.  Mathematical  approaches  to  simple  jamming  situations  are 
relatively  easy.  Solutions  to  the  problem  of  large,  jammer  rich  scenarios  must  still  be 
developed,  whioh  must  combine  the  mathamatical/technical  support  (triangulation)  with 
tactical  judgement  and  measures  in  this  jammed  areas, 

The  data  base  for  a  first  "Triangulation  Model"  will  be  time  delays,  load  faatora  for  DC 
and  DP,  probabilities  for  positive  ranging,  and  probabilities  of  ghost  targets.  For  a 
specified  radar  and  its  computer,  all  of  these  data  mainly  depend  on  two  factors!  The 
absolute  number  of  jammer  strobes  and  their  relative  density. 

3.2.6  Air  Picture  Analysis  and  Threat  Evaluation 

The  analysis  and  evaluation  of  the  air  picture  is  the  interface  between  the  passive  part 
(information  acquisition)  and  the  active  part  (ooiinter  actions)  of  the  air  defense.  The 
problem  of  this  part  of  the  A/D  game  is  that  it  is  impossible  to  include  the  judgement; 
processes,  the  experience  of  aommandera,  and  all  their  objective  and  subjective  aspects 
into  a  simulation,  except  by  a  man  -  in  the  -  loop  model.  Many  different  empirioal  threat 
evaluation  formulas  are  available  from  specific  air  defense  systems,  but  they  are  not 
applicable  to  a  general  air  defense  model. 

The  closed  general  simulation  model  hence,  must,  bo  restricted  to  the  combined  assessment 
of  the  moat  important  parameters  of  the  air  picture.  The  model  offers  the  basic  evaluation 
and  decision  methodology.  The  evaluation  parameters,  however,  must  be  selected  by  the 
user  as  must  be  the  Importance  (weighting)  of  these  parameters  and  their  logical  combi¬ 
nation. 

Some  of  the  usually  regarded  parameters  are  e.g. 

.  target  position  relative  to  the  feba 
.  target  altitude 
.  target  velocity  and  heading 
.  total  number  of  targets 
.  number  of  hostile  targets 
.  concentration  of  targets  etc. 

Other  factors  such  as  strategic  situation,  availability  of  own  forces,  knowledge  about  own 
deficiencies  etc.  might  -  more  indirectly  -  contribute  to  the  threat  evaluation  too. 

In  order  to  leave  thie  flexibility  of  choice  and  combination  of  parameters  to  the  user, 
tho  decision  table  principle  was  selected  as  a  general  purpose  methodology  for  the  threat 
evaluation  model.  As  can  be  seen  from  fig.  4,  three  different  steps  of  threat  analysis 
were  isolated! 

Evaluation  by  hoatlle  criteria! 

In  this  usually  rather  early  step  of  evaluation,  each  target  is  checked  whether  or  not 
it  meets  the  so  called  "hostile  criteria"  such  as  number,  position,  heading,  etc. 


.  Air  picture  evaluation i 

The  assessment  of  the  overall  air  picture  must  include  the  additional  criteria: 

Total  number  of  targets,  concentration  of  targets,  political  assumptions,  etc. 

This  evaluation  phase  results  in  decisions  on  the  alert  and  readiness  status  of  own 
air  defense  forces. 

.  Threat  ordering: 

Another  target  by  target  evaluation  must  be  executed  in  order  to  judge  the  threat  which 
can  be  expected  from  the  individual  targets  of  the  attack,  resulting  in  target  priority 
numbers  or  alike.  This  phase  provides  the  basic  evaluation  of  the  threat  as  an  input  to 
the  weapons  allocation  process. 

An  example  of  a  decision  table  input  and  some  decision  alternatives  for  the  threat  ordering 
evaluation  is  shown  by  fig.  7. 

All  the  three  threat  evaluation  routines  are  oalled  periodically  by  the  frame  program.  If 
desired  or  reasonable,  the  time  period  can  be  different  for  each  routine  or  it  can  even 
vary  throughout  the  simulation,  whiah  allows  an  assessment  adaptive  to  the  actual  situation. 

3.2.7  The  Alert  and  Combat  Readiness  Model 

The  core  of  this  part  of  the  simulation  is  the  decision  table  discussed  already.  Each 
decision  center  1b  responsible  for  the  command  of  a  certain  area  with  its  air  defense 
weapon  systems  deployed.  The  number  of  centers  and  the  size  of  the  area  is  a  first  order 
means  to  determine  the  degree  of  aontrol  centralization.  The  model  monitors  the  readiness 
status  of  the  weapon  systems  and  provides  the  transition  from  one  status  into  another  one 
if  bo  decided.  The  readiness  status  can  be  structured  the  same  way  as  the  presently  valid 
Defense  Readiness  Postures  or  differently,  which  will  be  particularly  necessary  when 
future  weapon  systems  are  considered. 

Furthermore,  the  model  monitors  the  availability  of  the  weapon  systems  resources  which 
depends  on  one  hand  on  the  alert  status  and  on  the  other  hand  on  the  actual  engagements 
and  engagement  results. 

3.2.B  Engagement  Alloaation  and  Coordination 

Up  to  this  point  of  the  simulation,  the  two  elementary  resources  for  the  weapons  allocation 
process, 

.  the  evaluated  air  picture  and 
.  status  and  availability  of  A/D  systems 
have  been  prepared. 

In  addition,  the  performance  data  of  the  weapon  systems  (range,  rate  of  fire  eto.)  and  the 
communication  facilities  from  the  command  centers  to  the  weapon  system  units  must  be  input 
to  the  allocation  model.  The  allocation  model  has  to  best  utilize  these  four  types  of 
information  in  order  to  serve  the  chosen  measure(s)  of  effectiveness,  In  principle,  one 
could  think  of  the  possibility  of  analytically  optimizing  the  alloaation  of  Blue  vs.  Red 
foraes  by  trying  to  maximize  or  minimize  the  respective  objeotive  function  which  generally 
has  the  same  dimension  as  the  MOE  applied.  It  was,  however,  realized  that  there  ia  no 
straight  forward  optimisation  possible, for  the  following  reasons: 

.  At  the  time  of  allocation  decisions,  the  result  of  the  decided  mensures  are  not  deter¬ 
ministically  predictable,  as  the  situation  may  change  during  the  execution  of  the 
decided  action. 

.  A  sequence  of  decisions  which  are  optimum  at  the  individual  points  in  time  may  not  necessarily 
lead  to  an  overall  optimum  effectiveness  of  the  air  defense  battle.  E.g.  a  high  initial 
engagement  ratio  can  result  in  a  maximum  achievable  number  of  killed  targets  (which 
might  be  the  temporary  objeotive  function) ,  however,  there  might  be  no  reserve  available 
to  cover  a  second  attack  wave  (which  might  contradict  to  the  overall  objective  function)  . 

•  It  must  be  possible  to  evaluate  optional, predefined  allocation  doctrines.  An  optimization 
algorithm  would  prevent  this  flexibility. 

Although  at  the  closing  date  of  this  paper  the  allocation  model  was  not  completed  yet,  the 
basic  approach,  has  already  been  defined  (see  fig.  8). 

The  model  must  provide  a  basic  software  which  allows  the  execution  of  various  types  of 
allocation  rules  and  restrictions,  selectable  by  the  user  of  the  model.  Some  examples  of 
rules  are: 

.  engagement  by  area  (e.g.  fixed  weapons  engagement  zones) 

.  low  targets  preferred 

.  no  simultaneous  engagement  of  the  same  target  by  fighters  and  SAMs  allowed 
.  only  one  (two  ...)  engagements  per  target 
.  engage  as  many  targets  as  possible 
.  Combat  Air  Patrol  (CAP)  policy,  etc. 


Using  che  status  files  and  tha  air  picture  as  input,  first  of  all,  a  series  of  alternate 
potential  allocations  is  calculated.  This  calculation  mainly  regards  the  engagement 
volumes  of  the  weapon  systems  in  question  and,  in  case  of  SAMs,  their  rate  of  fire  and 
mianiles  available.  In  case  of  fighters,  the  operating  ranges  and  tha  available  numbers 
o?  jortles  are  regarded.  This  general  allocation  part  also  accounts  for  the  dominating 
policy  rules  which  must  be  specified  in  advance  of  the  allocation,  e.g. 

.  prohibited  areas 

.  distribution  of  fighters  to  certain  rulas  (CAP,  GCX  etc.). 

These  restrictions  will  already  limit  the  total  number  of  potential  allocation  combina¬ 
tions, 

From  these  alternate  allocation  tables,  an  algorithm  which  regards  the  speoifio  tactical 
rules  and  restrictions  as  listed  before, and  the  available  communication  lines, selects  at 
least  one  "reasonable"  set  of  allocation  decisions.  These  are  affected  by  the  decision 
delay  times  and  are  finally  executed.  As  it  is  in  reality  this  will  be  only  ono  of  various 
possibilities,  the  effeots  of  which  must  finally  be  analyzed  off  line  and  manually  be  com¬ 
pared  to  the  air  defanse  objective  function,  whichever  it  might  be,  for  the  soenario 
envisaged. 

The  described  method  suggests  the  repeated  use  of  the  once  generated  general  allocation 
tables  (which  is  rather  time  consuming)  without  running  the  overall  model  again.  Applying 
different  sets  of  tactical  rules  in  the  later  part  of  the  model  results  in  an  accordingly 
greater  number  of  allocation  variants  which  provide  a  broader  result  basis  for  final 
evaluation. 

The  present  model  version  does  not  simulate  tha  engagement  of  the  weapon  systems.  The 
outcome  of  the  engagement  is  rather  estimated  from  the  rough  performance  data  which  were 
input  to  the  allocation  model.  It  is  but  left  to  the  user  of  the  model,  to  apply  the 
engagement  decision  data  as  input  to  off  line  weapons  engagement  simulation  models  if 
more  accurate  effectiveness  figures  are  requested. 

3.3  Limitations  and  Improvements 

Moat  of  the  model  limitations  and  restrictions  have  already  been  discussed  in  the  course 
of  this  paper,  particularly  in  chapter  2.2t 

.  no  dynamic  redeployment  during  one  simulation 

.  ECM  is  limited  to  noise  jammers  of  the  various  types,  and  chaff 
.  only  parts  of  the  different  IFF  procedures  are  modelled. 

The  size  of  the  scenario  is  limited  but  appears  sufficient  for  the  study  questions 
expeoted. 

Besides  testing, experimenting ,anu  actual  applications  of  the  first  model  version,  signifi¬ 
cant  modification  and  improvment  efforts  will  be  successively  undertas-en,  which  will  con¬ 
centrate  on  the  following  areas* 

.  modeling  of  triangulation 
.  inolusion  of  new  technologies 

(phased  array-,  multi  static  radars,  multiple  radar  tracking  etc.) 

.  emission  control  of  sensors  as  an  electronic  countermeasure 
.  implementation  of  a  group  track  routine 

.  refinement  of  event  and  queueing  control  of  the  DC  and  DP  model 
.  refinement  of  the  terrain  model. 


Problems  are  still  expected  with  the  acquisition  of  input  data,  as  soon  as  speoifio  air 
defense  systems  will  be  named  for  evaluation.  Three  types  of  resources  will  have  to  be 
utilized  for  input  data  generation  or  acquiaition. 

In  house  capability 

(technical  oil  line  aimulations,  particularly  in  the  area  of  radar  detection,  tracking, 
strobe  tracking  and  triangulation,  data  processing,  and  data  communications  are  partially 
available,  others  atill  have  to  be  developed.  They  serve  the  purpose  of  input  generation 
for  the  overall  model  on  one  hand  and  on  the  other  hand  these  simulations  provide 
valuable  tools  for  the  evaluation  of  technical  performance  and  feasibility  of  systems 
or  system  components,  respectively. 

Industry 

For  systems  in  the  conceptual  or  the  development  phase  the  detailed  technical  characteris¬ 
tics  will  be  requested  from  the  responsible  companies. 

Measurements 

From  simulated  or  rea'  exerciaes  or  from  testing  experiments,  life  data  of  fielded  systems 
such  as  delay  times, loads  of  components,  tactical  decisions, etc .  provide  an  additional 
data  base  for  simulation  or  model  verification  purposes. 


3.4 


Areas  of  Application 

Due  to  the  principles  as  discussed  in  chapter  3.1,  the  model  presented  offers  a  wide  range 
of  application  areas,  which  are  orientated,  of  course,  towards  the  overall  model 
structures 

.  radar  types,  deployments,  mixes 

.  data  processing  and  communication  systems  alternatives,  network  structures  etc. 

.  threat  evaluation  doctrines 

.  weapon  systems  alerting  procedures,  engagement  and  coordination  rules 

2 

.  mixes  of  weapon  and  C  systems 

2 

.  modes  of  control  and  integration  of  weapon  and  C  systems. 

in  these  areas  studies  of  different  type  can  be  supported  by  the  methodology  developed t 
.  feasibility  studies 

.  sensitivity  analyses  of  technical  and  tactical  parameters 
.  comparison  studies  of  alternate  systems 

.  trade  off  studies  of  different  subsystems  against  each  other. 

The  measures  of  effectiveness  can  be  chosen  within  the  range  of  the  classical  air  defense 
measures,  as  described  in  chapter  2.1.  Output  standards  have  not  been  settled  yet.  They. 
Will  be  developed  within  the  course  of  further  model  improvement  efforts. 

4.  CLOSING  REMARKS 

The  challenging  work  undertaken,  the  development  of  a  tool  which  quantifies  the  effective¬ 
ness  of  GW/C2  in  air  defense,  includes  a  relatively  high  risk  of  failure  because  of  the 
complexity  of  the  overall  problem,  and  because  predecessor  efforts  of  this  type  are  only 
available  in  some  specific  areas.  So  far  it  could  be  proven,  that  there  is  a  possibility  of 
modelling  C2  in  the  overall  air  defense  in  a  general  way.  Yet,  it  has  not  been  sub¬ 
stantiated  in  which  areas  the  application  of  the  model  can  deliver  results  Bignifioant 
to  the  question  and  where  not.  A  broad  interest  of  users  has  been  indicated  for  applying 
the  model  to  actual  questions  arising  in  the  planning  process  of  air  defense  Early 
Warning  and  Command  t  Control  systems. 
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Fig. 8  THE  ALLOCATION  MODEL 
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Abstract 


The  needs  for  a  single,  flexible  model  that  credibly  simulates  the  critical 
elements/inturactions  in  theater  air  defense  are  many  and  varied.  The  need  begins 
with  the  advanced  concepts  planner  who  needs  to  know  the  first  order  "theater 
ef feotiveness"  of  an  advanced  system.  The  need  continues  with  the  high  level  defense 
planner  who  must  make  a  critioal  decision  on  alternative  systems  to  develop  or 
manufacture.  The  need  typioally  ends  with  the  military  user  who  is  looking  for  the 
major  theater  tradeoffs  as  he  attempts  to  beat  plan  the  employment  of  his  resources 
against  the  threat.  TADENS-C3  is  a  theater  air  defense  model/methodology  development 
whose  goal  is  to  timely  (Nov  80)  produce  a  "credible,  agreeable,  and  uBable"  model/ 
methodology  to  address  tactical  (strategic)  theater  air  defense  and  its  associated 
problems/issues.  The  model  development  scope  is  designed  to  address  NATO  theater  air 
defense.  The  minimum  goal  is  to  be  able  to  address  the  NATO  Central  Region  to  include 
all  allies.  The  management  approach  includes  a  single  model  manager  (HQ  USAF/SA)  and 
a  process  whereby  the  analysis  centers,  system  developers  and  tacticians  of  the 
several  military/civilian  services  have  a  means  to  affect  the  credibility  of  the  final 
model.  It  is  this  "process"  that  wiil  hopefully  make  the  model  "agreeable"  to  the 
entire  air  defense  community  and  potentially  result  in  a  Eingle  model/methodology 
"useable"  by  all  greatly  simplifying  the  study/analysis  approach  for  the  systems 
decision  process.  The  nature  of  theater  air  defense  dictates  that  the  model/ 
methodology  "credibly"  addresB  such  key  interactions  as  follows i  explicit  C3,  ECM 
terrain,  weather,  airspace  control,  interoperability,  procedural  techniques,  IFF,  etc. 
The  model  is  being  built  to  address  these  interactions  with  a  flexibility  to  not 
include  a  given  interaction  (and  not  pay  the  associated  computational  price)  if  the 
interaction  is  not  wanted  or  needed.  Specific  attention  is  being  given  to  methodology 
to  model  endgame  attrition  of  flight  on  flight  and  flight  on  SAM/AAA  array  to  make  it 
as  realistic  as  analytically  practicable.  The  paper  contains  the  need  for  the  model, 
the  model/methodology  management  approach,  a  description  of  the  model  interactions 
(specific  attention  on  C3  modelling) ,  a  list  of  typical  problems  TaDENS-C3  can  address 
and  the  status/schedule  of  model  development/use. 


introduction 


Observations 


•  Technology  is  driving  weapon/system  development  to  more  sophisticated,  lethal, 
and  costly  weapons/sy stems. 

•  High  lethality  with  itB  potential  for  misuse  (against  both  foe  and  friend), 
dictates  the  need  for  higher  level,  more  effective,  command,  control  and 
communications,  C3. 


o  High  cost  of  new  systems,  given  budget  constraints,  implies  fewer  resource 
numbers  (most  likely  opposed  by  a  quantitatively  superior  threat)  which  one 
cannot  afford  to  misemploy  but  needs  to  be  "multiplied"  by  skillful  allocation 
through  effective  C3. 

o  But  C3  systems  are  also  very  costly,  some  very  vulnerable,  and  one  might 
potentially  overspend  on  C3  when  he  should  be  buying  more  resource  numbers. 


This  circular  logic  leads  to  some  interesting  questions  if  one  assumes  the  "law 
of  diminishing  returns"  (see  Figure  1) . 


Questions 


o  Which  weapons  systems?  How  many? 
o  How  much  c3? 

o  Is  more  resource  numbnrs  with  less  technology  better? 

o  What  is  the  comfortable  size  of  the  military  budget  to  at  least  assure  a 
neutral  outcome  (i.e.  where  are  we  on  Figure  1  which  is  very  difficult  to 
quantify?)? 

o  What  can  the  analyst  do? 


The  Analyst  Contribution 


Because  the  worth  of  a  military  system  must  be  measured  in  terms  of  its  military 
utility /effect  on  battle  outcome,  the  analyst  is  faced  with  modelling  the  large  scope 
battle,  its  key  interactions,  and  the  contribution  of  military  systems  to  those 
interactions.  In  esaense,  the  analyst  must  quantify,  within  reasonable  bounds  of 
confidence,  the  tradeoffs  implied  in  Figure  1. 


The  Analysis/Model/Methodology  Approach 


Systems  Versus  Learnlng/Is sues  Vers us  Interactions 


The  operations  analyst  is  regularly  faced  with  quantifying  the  military  worth  of 
a  system  (or  several  alternative  systems)  which  is  often  related  to  a  military  defense 
"issue."  As  such,  analysis  and  models  can  easily  be  heavily  weighted  to  the  Bystem/ 
issue  at  hand.  The  syutems  requiring  study  are  often  five  to  ten  years  into  the 
future,  involving  high  technology,  with  ill  defined  operations  concepts  and  requiring 
answers  now.  As  such  there  is  little  time  for  model  development  during  a  study  and 
the  analyst  is  often  faced  with  making  use  of  the  limited  tools  and  information  at 
hand. 


In  the  best  of  situations,  the  analyst  has  time  to  amply  explore  the  system, 
issue  and  their  interactions  in  relationship  to  the  total  military  forcer  he  also  has 
a  flexible  total  force  model  that  has  a  "basis”  (like  a  vector  space)  to  capture  the 
key  interactions  of  virtually  any  system  to  be  placed  into  the  total  force.  A  model 
with  such  a  "basis*  of  interactions  looks  to  the  future  and  has  a  long  lifetime  of 
utility  with  limited  need  to  modify  the  model  or  evolve  it  over  time.  It  also  is  a 


model  that  allow*  one  to  study  the  military  worth  of  an  element  in  the  baeie  (i.e. 
what  ia  the  military  value  of  more  "information”  in  theater  air  defense?)  without 
reference  to  a  specific  system.  This  "sheds  light"  on  the  importance  of  the  element 
and  all  the  systems  whose  major  contribution  is  that  element.  It  is  a  model  that 
promotes  learning  about  the  importance  of  key  interactions. 


Crcdlble/Agreeable/Useable 


Since  total  force  analysis  cuts  across  many  military  organisational  raaponaibili- 
ties,  functions  and  disciplines,  there  ia  a  real  need  to  coordinate  and  get  major 
agreement  on  the  following) 

e  The  model  and  its  interactions 

*  Database  for  the  model 

The  model  also  must  afford  a  transparent,  easily  described  structure  to  specify  how 
military  forces  are  deployed  and  employed.  The  end  result  is  an  "agreeable"  analysis 
tool  with  many  users. 


However,  to  be  "agreeable”  (producing  acceptibility  of  results)  the  model/ 
analysis  must  be  believable.  This  "credibility"  of  model  analysis  results  is  brought 
about  by  a  verification  process  peculiar  to  operations  analysiat 

e  A  credible  whole  model  is  the  sum  of  its  oredible  parts  and  their  interactions 

e  The  model/analysis  results  and  trends  must  make  sense  and  cause/effect  must  be 
traceable 

e  Model  results  need  to  compare  well  with  limited  scope  test  results 

The  first,  results  from  a  model  development  whose  origin  begins  with  a  thorough 
examination  of  the  problem,  its  parts  and  potantial  interactions.  The  second,  results 
from  a  good  database,  a  model  with  sufficient/flexible  output,  and  keen  analysis  of 
cause  and  effeat.  The  last  is  a  bonus,  if  one  is  fortunate  to  find  a  good  documented 
test  case. 


And  finally,  to  be  "useable,"  the  model  must  not  be  overburdened  with  unnecessary 
detail  that  requires  one  to  gather  a  difficult  database  and  that  dictates  very  long 
computation  time. 


The  TADENS-C3  development  process  has  been  strongly  guided  by  the  above  principals 
with  much  emphasis  on  the  following: 

*  A  thorough  examination  of  the  theater  air  defense  problem/interactions  and 
definition  uf  a  model  with  a  "basis"  of  key  interactions. 

e  Coordination  on  the  model  development  with  a  broad  spectrum  of  military /defense 
organizations  involved  in  air  defense. 

The  model  Is  planned  to  be  available  Nov  80.  Only  time  will  tall  if  the  model  manage¬ 
ment  process  produces  a  result  that  is  credible,  agreeable  and  useable. 


Theater  Air  Detente  Problem 


Problem  Scope 


The  nature  of  theater  air  defenae  intaractiona  and  the  queationa  being  aaked  to 
be  quantified,  dictate  the  need  for  a  thoater  level  model  with  the  following  key 
interactional 

e  Defensive  counter  air  (DCA) /Offensive  counter  air  (OCA)  operations 

e  Coalition  DCA/OCA  over  a  broad  geopraphical  area  (i.e.  NATO  Central  Region) 

e  Environmental  effects  (terrain,  weather,  electronic  counter  measures,  weapons 
effects) 

e  Interoperability  of  forces  of  diverse  nature 
e  Explicit-procedural  ^/information 

e  Systems  (surface  to  air  missiles-SAM,  short  range  air  defense-SHORAD,  anti¬ 
aircraft  artillery-AAA,  fighter  interceptors-PI ,  identification  friend  and 
foe-IFF,  navigation)  and  deployment 

e  Logistics  of  SAM/FI 

e  Identification/airspace  control/fratricide 
a  Tactics/procedures/employment 


TAOENS-C3  Model  "Basis" 


The  TADENS-C3  model  is  being  designed  to  include  the  aforementioned  broad  "basis" 
of  interactions  to  provide  a  model  for  learning.  A  basic  one-sided  "mirror  image"  of 
the  force  model  is  shown  in  Figure  2,  The  computer  programming  of  the  interactions  is 
such  that  a  given  interaction  can  be  taken  out  of  the  model,  through  input,  and  not  pay 
the  aaaociated  computational  price  if  the  interaction  is  not  wanted  or  needed.  The 
level  of  detail  in  an  interaction  is  such  to  capture  the  essinse  of  its  effects  yet 
keep  model  computation  time  to  a  minimum.  As  the  model  is  used,  and  learning  occurs 
on  the  importance  of  interactions,  some  interactions  may  be  taken  from  the  model  input 
to  improve  computation  time. 


C3  Model  "Basis" 


Figure  3  shows  the  "basis"  of  interactions  included  in  the  C3  part  of  the  model. 
Input  is  flexible  to  allow  the  analyst  to  build  whatever  C3  system/network  is  needed. 
The  following  additional  "basis"  of  interactions  are  defined  and  planned! 

a  Capacity  of  sensors,  links,  nodes 

e  Content  and  quality  of  information  (messages)  from  senaors/units 
-  e  Terrain/ECM/kill  interruptions 
•  Node  level  of  command 
e  Link  data/measage  restrictions 
e  Separate  networks/fusion  at  common  nodes 


(Lynch,  U.H.D.,  1979)  1*  the  definition  of  change*  to  an  existing  model  DADENS-C2 
that  ia  currently  planned  to  provide  the  framework  for  TADENS-C3.  A  portion  of  thia 
reference  ia  provided  aa  an  appendix  to  thia  paper  to  provide  the  reader  with  a  aample 
description  of  the  level  of  detail  defined  for  the  "basis"  of  interactions  in  TADENS-C3. 


Quantifiable  Tradeoffs 


The  following  is  a  list  of  foreseeable,  qurntif iable  tradeoffs  inherent  in  the 
TADENS-C2  "basis"  of  model  interactions t 

e  Military  worth  of  more  C3  versus  more  resource  (i.e.  SAM/FI) 

•  Military  worth  of  more  timely,  accurate  information  on  air  defenae 

e  Impact  of  "iCM-rasistant,  interoperable  IFF  on  identification 

e  Changes  in  FI  fratricide  under  different  (procedural  vs  close  C3)  airspace 
control  technique* 

e  Mix  of  Fla  (mobile/flexible  but  C3  and  weather  dependent)  and  SAMs  (lethal, 
quick-reacting  but  not  mobila) 

•  Key  ground-air  reaourca  survivability  (C2  center*,  AWACS,  etc.) 
e  Impact  of  ground  senior  netting  for  SHORADS 

e  Impact  of  grouhd  aenaor  turnoff  (increased  aurvivability)  with  AWACS  capability 
e  Interoperability  of  FX  with  baae  logistics  in  MATO 
e  Impact  of  not  aanaing  real  killers  (bombers?)  in  a  massive  attack 
e  Point  defense  versus  area  defense 
e  C3  syatem  capaoity/aaturation  effect* 

e  Impact  of  holding  SAM/FI  resource*  in  reaerve  for  better  force  utilization 
over  time 

e  Impact  of  satellite  relay/navigation  (more  aurvivable?)  on  force  ef feotivenes* 
over  time 

e  Stockpile*  of  weapons  needed/uso  rate  in  a  massive  attack 


Model/Pevelopment  Statu* 


Modal  Framework 


The  Divisional  Air  Defenae  Engagement  Simulation-Command  and  Control  (DADENS-c2) 
in  an  existing  modal  whose  framework  (75,000  lines  of  code,  six  modulss-500,000  bytes 
largest  module)  is  a  candidate  for  the  TADENS-C3  model.  Aa  of  July  1979,  DADENS-C2  is 
completely  user  documented,  mathematically  verified  with  four  structured  and  documented 
teat  caaea,and  operating  on  an  IBM  3032  computer.  The  model  capabilities  have  been 
compared  against  the  desired  theater  air  defense  "baeia"  of  interactions  and  the 
required  changes  defined.  A  powerful  model  in  its  own  right,  DADENS-C2  taken  about 
three  man-months  to  train  an  analyst  to  uae  and  interpret.  While  TADENS-C3  is  in  final 
development,  DADENS-C2  will  be  used  to  study  specific  problems  for  which  it  is  credible. 
Documentation  on  the  existing  DADENS-C2  model  is  at  ref arence (BDM  Corporation,  1979). 
Results  of  the  teat  cases,  and  modal  "usaability , "  ia  currently  in  analysis  at  the  time 
of  thin  paper.  An  evaluation  of  the  DADENB-C2  model  and  the  defined  changes  will  be 
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done  by  a  broad  spectrum  of  US  militery/defense  organisations  in  early  August  1979. 


Tentative  Schedule 


Provided  the  DADENS-C2  model  is  chosen  as  the  modal  framework  to  modify,  the 
TADENS-C3  model  capability  should  be  available  by  November  1980.  The  decision  point 
on  DALENS-C2  development  is  planned  for  August  1979.  Current  information  on  TADENS-C3 
development  status  will  be  verbally  reported  at  paper  presentation. 
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Appendix 


I  DEFINITION  OF  ECM/ECCM  INTERACTIONS 


1.  ECM  Generators 

a.  Threat  Types  -  Standoff  jammers  (SOU) ,  escort  jammers  (ESJ) ,  and  ground  jammers 
(GDJ)  will  be  modelled.  The  ECM  threat  will  be  attackable  by  Blue  defense  resources 
as  follows i 


ECM 

-'-^Threat 

Defense 

SOJ 

ESJ 

GDJ 

SAM 

X 

X 

AAA 

X 

X 

Artillery  (BM) 

X 

DCA  FI 

X 

X 

Blue  Strike 

X 

X 

Blue  OCA  Celle 

X 

X 

b.  Defense  (Slue)  Types  -  Blue  strike  escort  jammers,  ground  jammers  and  standoff 
jammers  will  be  simulated  in  like  manner  as  para  l.a.  A  capability  will  be  added  to 
designate  a  variable  number  of  the  63  FI/SAM  defenses  in  DADENS-C2  as  "Red."  The  Red 
defenses  will  interact  with  Blue  strike/OCA  aircraft  in  like  manner  as  the  "proposed" 
Blue  defenses  in  TADENS-C3.  A  portion  of  all  current  threat  cell*  (types  aircraft  also) 
other  than  Blue  strike,  will  have  the  capability  of  being  identified  In  the  input 
(and  in  the  IDENT  AIRSPACES)  as  a  Blue  OCA  strike  force. 


As  such,  Blue  ground  jammers  ehall  be  targetable  and  vulnerabla  to  all  currant 
Red  threat  typee  and  vice  versa.  Blue  SOJ  shell  be  vulnerable  to  Red  SAM/ AAA  and  Red 
cells  with  an  alternate  mission  to  sense  and  attack  Blue  (non-reacting)  SOJ  (i.e. 
similar  to  Red  KILLER  threat  to  AWACS).  Red  defenses  (i.e.  SAM/C3  network)  shall  have 
the  capability  to  sense  a  Blue  AWACS  and  attack.  The  converse  shall  be  true  for  Blue 
Strike/OCA  cells  end  SAMa  against  the  Red  AWACS. 


2.  ECM  Equipment 


All  Red/Blue  ECM  threat  types  shall  be  capable  of  carrying  the  frilowing 
types  (in  variable  mimbor)  of  ECM  equipment i 


Equip 

ECM 

Noiee  Jam 

Deception 

Carrier 

Barrage 

Spot 

SSJ 

Smart 

Chaff 

Flare 

Electronic 

80J 

X 

X 

ESJ 

X 

X 

9 

mm 

X 

X 

X 

GDJ 

X 

— i 

9 

HE 

■■ 

A/C  Cell 

1 

1 

55 

X 

X 

Each  ECM  carrier  shall  have  input  to  define  several  fixed  time  intervale  to 
turn  ECM  equipment  on/off.  The  noise  jammers  on  carriers  shall  be  modelled  by 
standard  jamming  power/range  equations  constrained  by  ooverage  geometry  defined 
relative  to  the  oarrier. 


3,  ECM  Environment  Generator  Module 

The  time  dynamic  ECM  carrier/equipment  definition  in  para  1  and  2  shall  be  used 
to  aompute  the  ECM  environment  (i.e.  jammer  signal  power  in  a  variable  frequency  range) 
at  any  point  in  apace.  Terrain  masking  shall  not  be  currently  considered  but  near 
earth  line  of  eight  conatreints  shall  be  considered  for  ground  jammers. 

A  precomputed  (PEG  like)  ECM  environment  generator  (fixed  time  interval)  stored 
on  diac/tapa  shall  be  examined  aa  a  means  to  save  computation  time  for  a  specific 
threat/defense  scenario.  Knowledge  of  ECM  generators  killed,  on/off,  at  a  specific 
time  can  be  used  to  compute  the  ECM  environment  at  a  specific  spatial  point.  Since 
both  Red  and  Blue  ECM  threats  are  considered,  self  jamming  of  Red/Biue  defense  will  be 
inherent  in  the  ECM  Environment  Generator  Module. 

4.  ECM  Effeota 

ECM  impacts  on  Red/Blue  defensive  elements  shall  boi 

A.  Noise  into  radar  antenna/IFF  equipment/navigation 
11.  Jamming  of  aommunioation  links 

C.  Deoeption/dogradation  of  radar  information/quality 

D.  Degradation  of  launched  weapona 


a.  Radars 

(1)  All  ground  surveillance  radars  shall  be  subject  to  Impacts  A  and  C, 
Consideration  will  be  given  to  a  means  to  model  impact  of  A  and  C  on  the  "simple"  radar 
model  for  SAM/AAA  units.  All  individual  ground  radiating  targets  shall  have  a 
capability/option (determined  by  input)  to  sense  ARM  attack  and  automatically  turn  uff 
radar.  An  option  shall  be  added  to  turn  off /on  individual  radars  at  time  intervale 
fixed  at  input. 

(2)  Air  Surveillance 

AWACS  and  satellite  radars  shall  also  be  subject  to  impacts  A  and  c.  The 
ECM  Module  shall  be  constructed  in  a  way  that  includes  modelling  jamming  of  individual 
FI  radar  (see  para  II3c!5) . 

(3)  ECCM 

Command  and  control  tachniques/procedurea  shall  be  examined/modelled  to 
aimulate  the  capability  of  C2  centere  to  triangulate  or  allocate  a  resource  to  fly 
down  a  strobe. 

b.  Communication  Links 

All  ground/air  communication  links  (explicit,  implicit,  or  implied)  shall  be 
subject  to  impact  B.  The  major  afreet  will  be  a  relationship  between  B/J  ratio  and 
message  error  (i.e.  no  information,  partial  information,  message  repeat). 

c.  IFF  Equipment/Navigation 

Several  types  of  IFF  equipment  will  bo  modelled  to  place  on  all  defensive 
units.  A  match  of  IFF  equipment  shall  be  required  for  a  potential  correct  IFF  response. 
IFF  on  all  aircraft  shall  have  the  capacity  to  turn  on/off  by  praspecifiad  input  time 
intervals.  IFF  equipment  on  aircraft  shall  have  defined  interrogation  geometry  for  a 


potential  correct  IFF  response  as  a  function  of  interrogation  capacity  and  ECM 
environment  at  sender  and  receiver.  For  navigation  see  para  112. 


d.  Weapon  Effects 

All  weapons  (SAM,  AAA,  BM,  RPV ,  guided  bombs,  ASM,  ARM,  etc.)  shall  be  subject 
to  degradations  (i.e.  reduced  CEP,  SSXP,  etc.)  resulting  from  the  ECM  environment 
through  whioh  they  must  transverse. 

5.  Model  Change  Mechanisation 

As  much  as  possibls,  all  modal  change  shall  be  made  in  a  manner  that  tha  interac¬ 
tion  can  be  eliminated  through  model  input  and  not  impact  the  model  configuration/run 
time/ef  f iciency . 

II  DEFINITION  OF  SENSOR/INFORMATION  QUALITY  CHANGES 

1.  Visual  Model 

An  additional  visual  model  will  be  added  and  capable  of  being  attached  to  the 
following  entities  be  they  Blue  or  Radi  SAM,  AAA,  DCA  fighter  interceptors,  OCA 
aircraft.  Ten  (10)  types  of  visual  models  will  be  oapable  of  input,  any  one  type  whioh 
can  be  attached  to  a  given  resource  entity.  Two  range  inputs,  for  each  entity  (ground 
or  air)  capable  of  being  acquired  by  the  visual  sensor,  will  define  the  model  as 
follows  I 


Information  at  each  range 

Distribution 

Default 

"type"  entity  identification 
number  of  entities 

uniform 

normal 

perfact 

perfact 

If  the  entity,  having  the  visual  modal,  is  in  a  weather  airspace  (sea  para  III)  of 
specified  visibility  range,  this  latter  range  will  limit  the  visual  model. 

2,  Navigation  Site/Sensor  Model 

A  navigation  capability  will  be  Modelled  which  can  be  attached  to  any  node  of 
a  C3  network.  The  model  will  be  a  1/R2  signal  strength,  line  of  sight  transmission 
model  constrained  by  azimuth/elevation  limitations.  There  will  be  the  capability  to 
have  up  to  five  (S)  types  of  navigation  systems.  The  accuracy  of  the  system  will  be 
modelled  by  normal  distributions,  on  position  and  velocity  accuracy  of  update,  as  a 
function  of  number  of  received  signals.  The  node  navigation  capability  shall  be  lost/ 
damaged  in  the  same  manner  as  the  node.  Entities  in  the  scenario  shall  be  capable  of 
receiving  navigation  updates  provided  they  are  characterized  as  follows i 

s  Entity  has  a  rece.ivar  on  board  of  the  navigation  system  type, 

e  Signal  strength  required  to  receive  a  signal  ia  available  from  the  source. 
(Navigation  link  susceptibility  to  ECM  jamming  will  ba  included  in  the 
model) 

e  Minimum  number  of  received  signals  needed  are  available  at  the  receiver. 

3.  Radar  Models  (all  currant  types  in  model) 

a.  information  Quality 

Physical  acquisition  of  objects  by  radars  will  bs  modelled  as  currently 
done.  However,  the  information  content/quality  at  acquiaition/during  tracking  will  be 
a  function  of  range.  A  variable  number  of  range*  will  be  input  for  each  radar  type. 

At  each  input  range,  the  following  inputs  will  characterize  the  content  and  quality  of 
the  aoquiaitiori/traoking  information i 


Information  Content 

Quality/Distribution 

Default 

"type"  entity  identification 

uniform 

perfect 

number  of  entities 

normal 

perfect 

position  of  entities 

normal 

perfect 

velocity  vector 

normal 

perfect 

"Type"  information  above  will  be  added  to  the  IDENTIFICATION  airapaee  logic, 
b.  Law  Level  Clutter/Multipath 

A  separate  volume  shall  be  defined  for  each  positioned  radar  in  which 
acquisitions  are  degraded  due  to  v luttar/multipath.  Acquisition  information  content/ 
quality  within  this  volume  will  be  characterized  by  a  different  set  of  inputs  as  in 
para  3a. 
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c.  Radar  Model  Capacity 


1  i  i 

1  I 

i 

i 
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1)  Aircraft  Typaa  -  A  capability  will  be  added  to  allow  (or  limit)  a 
radar  type  to  aee  any  and  all  types  of  aircraft,  which  must  finally  be  classified  as 
HOSTILE/FRIEND/UNKNOWN  in  the  C3  network  per  logic  of  the  IDENTIFICATION  airspace. 

2)  Track  Production  Areas  (TPA) 

A  fixed  airspace  (TPA)  will  be  associated/attached  to  each  radar. 
Though  the  radar  may  acquire  objects  outside  the  TPA,  the  radar  does  not  send  an 
acquisition  massage  through  the  C3  network  unlesa  the  objeot  is  in  the  radar's  TPA. 

3)  Track  Capacity 

An  input  will  be  added  which  limits  the  number  of  tracks  that  a 
radar  can  handle  within  its  TPA.  A  saturation  message  will  be  sent  to  the  PCC  at  the 
beginning  of  saturation  and  at  its  conclusion.  Objeata  determined  as  FRIEND  will  be 
dropped  from  this  capacity  accounting. 

4)  Satellita/Sensora/Communications 

Position  of  satellite/sensors  shall  be  capable  of  input  (latitude/ 
longitude  or  UTM)  as  a  function  of  time.  Communication  links  between  satellites  or  to 
the  ground  shall  be  limited  by  LOS/Earth  constraints.  Current  radar  model  and  naviga¬ 
tion  sensor  (aee  para  2)  will  be  associated/carried  by  a  specific  satellite. 

5)  Aircraft  Sensing  (Radar)  Model 

In  addition  to  the  visual  model  (para  1) ,  a  radar  modal  will  be 
added  to  each  aircraft  type  for  acquisition.  For  each  type  entity  which  the  radar  can 
acquire,  the  following  inputs  will  be  possible i  relative  range  at  which  entity  is 
sensed;  positive  relative  altitude  limit;  lower  relative  altitude  limit.  As  suoh,  a 
range  and  altitude  cheok  determines  if  the  aircraft  aoquire  an  entity.  No  information 
othor  than  the  relative  position  of  a  potential  target  is  to  be  implied  by  thie 
aoquiaition.  Degradation  of  the  radar  range  by  ECM  will  be  modelled  (eeo  para  I4a  ). 

Ill  WEATHER  MODEL  DEFINITION 

A  weather  airspace  (•)  will  be  defined  by  centerline  (two  points) ,  width  and 
altitude  band  (two  points)  inputs.  Within  this  airspace  a  visibility  range  will  be 
modelled  aa  a  function  of  time  and  linearly  interpolated.  The  visibility  range  in 
the  airspace  will  limit  the  visual  model  of  para  II  1.  Knowledge  of  weather  it  PCCs 
will  be  perfect  information  but  delayed  by  a  time  interval  dafinad  by  input. 

IV  COMMUNICATION  NETWORK  CHANGE  DEFINITION 

1.  Communication  Network 

Links  between  nodes  (senders/rsceivers)  will  be  associated  with  a  specific 
network  name.  Information  on  this  network  must  be  transmitted  over  links  dsflned 
for  this  network.  Multlpla  links,  between  nodes  in  a  network,  shall  ba  limited  (by 
input)  to  specific  message  "types/numbors. "  A  flexible  switching  logic  shall  be 
constructed  at  a  node  having  multiple  links  to  another  node.  A  node  will  have  a 
capability  for  data  "fusion"  (by  input)  batween  different  networks  at  the  same  node. 
Several  communication  link  routing  logics  between  sender  and  receiver  (i.e.  shortest 
time,  minimum  links)  will  be  implemented. 

2.  Unit  Status  Information 

Unit  status  information,  which  is  used  in  the  decision  process  of  resouros 
allocation  through  command  and  control,  will  be  integrated  into  the  information  flow 
modelling  of  the  model. 

3.  Links 

A  capability  to  diaconnect/reconneat  a  communication  link  (i.a.  at  any  point 
on  a  path  from  sender  to  receiver)  based  on  time  wilJ  be  constructed  in  the  model. 

Air  to  air  and  air  to  ground  links  will  bs  LOS/Earth  eonstrainad  (not  terrain) . 

Explicit  jammable  links  will  be  defined  to  and  from  aircraft  within  the  C3  network. 

4.  Command  and  Control  Centers 

a.  Message  "type"  priority  for  processing  will  be  defined, by  input  for  each 
C2  center.  Because  TPAs  (see  para  Il3c2)  may  overlap  or  because  a  C?  carter  may 
receive  eeverel  tracks  (of  different  quality)  on  a  single  threat,  a  track  correlation 
(uniform  distribution  on  perfect  track  correlation  knowledge)  model  will  be  implemented. 
On  thoae  tracks  which  do  correlate,  a  "track  quality"  modol/decision  process  will  be 
employed.  A  workload/capacity  model  will  be  constructed  for  the  C2  center  decision 
process. 


iu 


y-iu 


b.  Tactical  Network  Control 

If  a  radar  below  the  PCC  has  bean  destroyed  (assume  perfect  information) , 
the  PCC  shall  have  the  capability  to  assign  the  TPA  of  the  destroyed  radar  to  another 
radar  in  its  network  (i.e.  assign  alternate  TP As  to  radars  at  Input)  after  a  fixed 
decision  delay  time.  A  PCC  in  a  DEFENSE  shall  be  limited  to  control  specific  resource 
types/looatlons  defined  by  data  input.  PCCs  at  a  lower  level  in  the  c’  network  will 
send  messages  to  a  PCC  at  higher  level  on  force  allocation  to  targets.  .  The  PCC  at 
the  higher  level  will  send  messages  to  control/interrupt  the  resource  allocation  of  the 
lower  PCC  based  on  the  information  it  has  available.  New  command  and  control  messages 
will  be  defined  (see  para  VII)  for  a  high  level  PCC  which  will  be  limited  to  flow 
over  specific  links  (sse  para  IV  1)  to  lower  level  PCCs. 


ELEM  ENTS/  INTERACTIONS 
ELftlfNTS/ INTERACTIONS 


C’  MODEL  "BASIS" 
BASE"  DE  MODULE  C* 


<=>  NODE /NODULE 

SATELLITE /SATELLITE 

SENSOR  /  RADAR  /  DETECTEUR  /  RADAR 

AIRCRAFT/AVION 

_  GROUND  LINK/ LIAISON  (TERRE) 

SAM/SHORAD 

AIR  LINK/LIAISON  (AIR) 

■ 

NAVIGATION/NAVIGATION 

«— ►  DIRECTION/DIRECTION 

• 

IFF 

AIRBASE/SASE  ADRIENNE 

S 

SWITCHING/COMMUTATION 

VHW  AWACS 

F 

FUSION/FUSION 
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SIMULATION  Of  AIR  DEFEMCE  OPERATIONS  AND 
MULTIPLE  AIK  COMBAT 

H.R,  Wilhelm 
SHAPE  Technical  Centre 
P.O.  Box  174 
The  Hague 
Netherlands 

SUMMARY 


This  paper  describes  the  air  dafenae  system  simulation  model  in  use  at  the  SHAPE  Technical  Centre.  The 
model  comprises  detailed  submodels  for  airborne  and  ground-based  early  warning  sensors,  command  and 
control  operations,  ground-oontrollad  interoopts,  multiple  air  oombat  engagements,  and  electronic  counter¬ 
measure  operations.  Modifications  in  hand  will  include  the  simulation  of.  surface-to-air  missile  systems 
and  will  permit  the  interactive  running  of  the  model  as  a  one-sided  wargaming  system  with  a  battln 
manager  commanding  and  controlling  his  air  defence  ferae  via  graphics  displays.  The  computer  cor  figuration 
used  in  running  the  model  is  described  and  also  the  specific  software  methods  employed.  A  three- 
dimensional  graphics  facility  was  developed  to  facilitate  the  evolution  and  validation  of  tactics  for 
modern  fighter  aircraft  and  future  missiles.  Additional  validation  methods  were  applied,  such  as  the 
correlation  of  model  results  with  live  flying  trialB.  The  paper  closes  with  a  brief  aooount  of  past,  and 
possible  future  applieutions. 

1,  INTRODUCTION 


In  1975  the  SHAPE  Technical  Centre,  The  Hague,  Netherlands,  initiated  the  development  of  a  theatre-level 
model  for  the  simulation  of  integrated  air  dafenae  operations.  At  that  time  it  was  realised  that  the 
operations  analysis  community  in  general  and  SHAPE  Technical  Centre  in  particular  were  lacking  the  tools 
for  the  oredible  assessment  of  the  operational  performance  of  air  defenoe  systems.  An  air  defence 
system  may  be  considered  as  being  composed  of  several  subsy statist 

-  An  air  surveillanaa  subsystem 

-  An  air  resource  allocation  subsystem 
••  A  weapon  oontrol  subsystem 

-  A  communications  subsystem 

-  Weapons  systems. 

In  reality,  the  first  four  components  are  combitiod  into  the  "Air  Command,  Control  and  Communication  System". 

The  air  defence  system  is  extremely  aomplax,  with  many  interactions  between  its  subsystems  at  various 
levels  of  command.  Because  of  this  and  because  of  the  lack  of  experience  in  the  design  and  validation  of 
a  model  describing  such  a  large  system,  it  was  decided  that  the  process  of  developing  the  model  should  be 
split  into  several  phases  and  that  the  scope  of  each  phase  should  be  dependent  on  the  experience  gained  in 
previous  phases.  As  a  result  model  development  is  a  time-consuming  evolutionary  process  extending  over 
several  years  and  interrupted  by  production  periods  when  the  evolving  model  is  in  use, 

The  first  phase  in  model  development  was  concerned  with  establishing  a  framework  and  structure  fir  the 
complete  model  with  some  parts  being  fully  implemented,  The  product  of  the  first  phase  of  development  is 
the  "COMO  Interceptor  Operations  Modal" .  Particular  emphasis  was  placed  on  the  final  stage  of  the 
intercept  process,  the  interactions  between  groups  of  opposing  aircraft,  as  it  was  determined  that  statements 
on  the  factors  affecting  the  outaome  of  air  combats  were  virtually  unsupported  by  hard  facts  or  credible 
analyses  and  were  mainly  governed  by  subiective  and  very  often  contradicting  personal  opinions  of  fighter 
pilots.  It  was  felt  that  the  effectiveness  of  c.ir  defence  systems  could  be  determined  only  if  the  final 
stage  could  be  represented  credibly. 

It  was  deoided  to  implement  the  detailed  engagement  tactics  of  m  versus  n  aircraft  because  only  one-versus- 
one  simulation  programs  and  simulators  were  available  and  this  appeared  to  be  completely  unrealistic  sinoe 
no  air  force  in  the  world  would  send  one  fighter  on  a  mission.  There  were  no  means  for  extrapolating 
from  the  results  of  ona-varsus-oue  simulations  to  those  of  many-versus-many . 

This  paper  is  split  into  five  parts i  the  first  part  contains  a  dorcription  of  the  current  operational 
status  of  the  interceptor  model,  the  second  and  third  parts  give  an  outline  of  the  computational  techniques 
used,  the  fourth  part  is  corioerned  with  the  validation  methods,  and  the  fifth  and  final  part  deals  with  the 
modifications  in  hand  to  oonvert  the  interceptor  operations  model  into  an  air  defence  system  simulation 
model ■ 

I.  THE  COMO  INTERCEPTOR  OPERATIONS  MODEL 

2.1.  Description 

The  COMO  Interceptor  Operations  Model  is  a  theatre-level  air  oombat  model  for  the  simulation  of  the  ground 
and  air  operations  of  a  force  of  air  defence  fighters  against  multiple  raids.  The  model  design  was  a  co¬ 
operative  effort  of  the  General  Research  Corporation,  Huntsville,  and  the  SHAPE  Technical  Centre,  The  Hague. 
The  model  includes  simulations  of  the  functions  oft 

-  Ground-based  and  airborne  early  warning  sensors 

-  Command  and  control 

-  Airbase  operations 

-  Ground-controlled  intercept  mission  profiles 

-  Airborne  target  detection,  acquisition,  and  selection 

-  Airborne  missile  launch  computer 


-  The  human  decision-making  process  of  selecting  aircraft  manoeuvora 

-  Aircraft  manoeuvers 
Missile  lock-on 

•  Missile  launch  and  fly-out 

-  Missile  and  game  effectiveness  function. 

The  conceptual  model  structure  of  the  defending  side  is  shown  in  Figure  1.  The  defence  elements  consist 
of  airborne  and  ground-based  sensors,  t.raok  files,  and  airbases  linked  to  one  of  several  possible  Command 
and  Control  Cafitresi  fighters  art  linked  to  their  respective  airbaBes  and  eaoh  fighter  can  carry  one  or 
two  types  of  missiles , 

The  conceptual  model  structure  of  the  attacking  side  is  indicated  in  Figure  I.  Medium  bombers,  fighter 
bombers,  escort  fighters,  self -screening  jammers,  escort  jammers  and  stand-off  jammers  may  be  the  elements 
of  an  attacking  formation.  Esaort  fighters  and  self-soreening  jammers  may  carry  one  or  two  missile  types. 

Figure  3  indicates  the  sotiuer.ee  of  modelled  events.  A  typical  example  of  the  events  simulated  1st 

-  Formations  penetrate  into  an  area  to  be  defended 

-  They  may  or  may  not  be  detected  by  early  warning  sensors 

-  Tracks  are  built  up  on  targets  detected  and  resolved 

-  Interceptors  are  allocated  and  dispatched  against  the  threat 

-  Interceptors  fly  on  a  GCI  course  and  search  for  targets 

-  Upon  target  detection  the  interceptors  try  to  manoeuver  themselves  into  firing  position 
and  deliver  air-to-air  weapons 

-  Aftar  missile  launch  the  interceptors  may  engage  other  targets  or  return  ti  base  if 
their  fuel  or  missile  stock  is  depleted 

-  Attacking  aircraft  search  for  interceptors 

-  Upon  detention  of  interceptors,  fighter  bombers  run  away  and  escort  aircraft  engage 
in  air  combat  by  trying  to  manoeuver  themselves  into  position  to  deliver  air-to-air 
missiles. 

The  feature.,  modelled  arc  elaborated  in  the  following  paragraphs. 

Sensors  report  plot  Information  on  deteatad  targets  to  the  Command  and  Control  Centre ,  which  is  supposed  to 
represent  the  aombined  intelligence  and  computer  power  of  the  Ground  Environment  System.  In  reality,  the 
task  performe4  by  our  single  Command  and  Control  Centre  would  be  performed  at  different  levels  of  command 
and  at  different  locations.  For  the  simulation  program,  however,  this  does  not  make  any  difference,  except 
for  the  time  delays  whioh  are  represented  in  the  model. 

The  Command  and  Control  Centre  correlates  the  plot  Information  with  tracked  targets  and  uses  it  to  update 
target  tracks  and  to  build  Up  new  target  tracks  if  the  plots  do  not  correlate  with  any  tracks  already 
available.  In  the  book-keeping  for  a  suite  of  traok  fileB  a  target  count  is  performed,  the  count  depending 
on  the  resolution  capability  of  the  sensor  in  question.  Tracking  errors  resulting  from  system  parameters 
and  target  behaviour  may  be  superimposed,  as  Well  as  any  electronic  countermeasures  affecting  the  sensors. 

The  effects  of-'  triangulation  of  targets  in  heavy  ECM  conditions  can  be  simulated,  but  the  well-known  de¬ 
ghosting  problem  is  at  suited  to  have  been  solved.  There  is  no  deghosting  algorithm  in  the  program,  and 
there  are  no  tracks  built  up  on  ghost  targets. 

After  target  tracks  have  been  established,  the  Command  and  Control  Centre  ’allocates  air  resources  by  com¬ 
paring  available  fighters  on  airbases  and  on  ccmbat-air-patrol  (CAP)  patterns  with  hostile  tracks. 

Fighters  are  allocated  according  to  specified  criteria,  for  example,  to  attempt  to  minimise  enemy  penet- ation, 
to  attempt  to  maximise  airara.ft  range,  and  to  achieve  a  desired  fore  ratio  against  targets  counted.  Due 
tc  erroneous  target  counts  caused  by  limited  sensor  resolution  or  ECM  it  may  happen  that  an  insufficient 
number  of  fighters  is  allocated  against  the  threat  with  the  possible  consequences  of  lo  effectiveness  and 
a  high  loss  rata. 

If,  on  the  other  hand,  the  number  of  fighters  sl'_,.ited  1-,  More  tnari  sufficient,  the  defending  silo  may 
prove  to  have  allocated  a  significant  proportion  of  its  whole  fighter  force  against  a  few  targets,  and 
does  not  have  enough  resources  left  to  counter  a  second  or  third  raid  penetrating  possibly  some  vimti  .Tatar. 

This  brief  and  over-simplified  account  of  some  of  the  difficulties  associated  with  intelligent  resource 
allocation  of  fighters  against  the  air  threat  makes  it  clear  that  this  is  a  problem  of  enormous  complexity 
which  is  very  difficult  to  solve  by  "canning"  resource  allocation  policies  into  at,  algorithm,  It  is  in 

this  area  that  the  Intelligence,  pattern  recognition  capability,  and  intuition  of  a  real-world  battle 
manager  comes  into  play,  Therefore  it  is  only  logical  that  the  next  version  of  the  interceptor  model 
should  be  run  interactively  with  a  man-in-the-loop  to  cake  caro  of  the  resource  allocation  on  the  basis  of 
information  on  the  air  picture  and  the  resources  available,  presented  to  him  by  graphics  displays, 

Now,  independently  of  how  good  cr  how  bad  the  selected  resource  allocution  policy  may  be,  the  Command  and 
Control  Centre  eventually  decides  on  the  numbers  and  locations  of  fighters  to  be  deployed  and  passes  its 
orders  to  fighters  already  airborne  (for  example,  circling  in  CAP  patterns)  or  to  airbases  which,  after  a 
given  scrambling  time  delay,  launch  the  desired  number  of  aircraft.,  provided  the  aircraft  are  available. 

The  aircraft  fly  in  formations  assumed  immediately  after  take-off. 

Tho  Command  and  Control  Centra  guides  the  interceptor  formations  to  the  desired  kill  point  according  to 
a  specified  GCI  mode,  which  may  be! 

-  Close  control 
boose  control 

-  Broadcast  control. 
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The  attack  tactics  to  be  used  are  strongly  dependent  on  the  weapons  carried  by  each  of  the  participants. 
Tactics  incorporated  in  the  model  include: 

-  Cut-off  tactic  (for  all-aspect  weapons) 

-  Final  turn  lead  collision  course  (for  rear  hemisphere  infrared  weapons) 

-  Pursuit  course  (for  example  against  targets  being  triangulated) 

-  Single  turn  tactic  with  a  predefined  traok-orossing  angle. 

Interceptors  search  for  targets  using  airborns  detection  devices  such  as  A/I  radar,  FLIR,  TV,  or  the 
human  eyeball.  The  performance  of  the  sensors  is  represented  by  detection  ranges,  single  scan  probability 
of  detection,  detection  cones,  or  scan  time.  All  the  variables  can  be  made  dependent  on  weather 
conditions,  ECM  conditions,  speeds,  altitudes,  and  other  system-dependent  or  target-dependent  variables. 

After  target  detection,  a  fighter  becomes  autonomous  and  there  is  no  link  to  the  Command  and  Control 
Centre.  The  fighter  is  now  "in  air  combat".  Each  aircraft  in  air  combat  passes  iteratively  through 
an  air  combat  decision  and  manoeuvering  logic  at  a  fixed  time  step.  The  air  combat  decision  and 
manoeuvering  logic  comprises: 

-  A  target  search  and  detection  logic 

-  A  target  selection  logic 

-  A  manoeuver  selection  logic 

-  A  missile  in-range  computation 

-  A  missile  launch  logic 

-  A  missile  fly-out  model 

-  A  logic  which  implements  the  manoeuver  selected  and  performs  all  integrations  and 
updating  of  all  aircraft  and  missile  state  vectors. 

The  target  selection  logic s  Each  fighter  selects  one  of  several  detected  targets,  depending  on  specified 
criteria,  and  continuously  updates  this  selection,  switching  over  to  a  "better"  target  if  there  is  one. 

Suoh  a  selection  could  be  based  on  an  estimated  time-to-kill  and  time-to-be-killed  with  respeot  to  each 
deteated  target,  and  the  target  ohosen  is  that  for  which  one  of  these  is  a  minimum.  Another  basis  for 
selection  could  be  geometrical  properties  such  as  distance  and  look  angle,  from  which  measures  of 
position  of  advantage  or  disadvantage  could  be  derived  for  the  possible  targets. 

All  these  logics  have  one  fault  in  common:  they  assume  perfect  knowledge  of  each  of  several  possible 
targets.  Another  assumption  is  that  a  pilot  would  be  capable  of  assessing  the  value  of  and  the  danger 
represented  by  each  of  several  deteetabla  opponents  and  would  finally  choose  the  "best"  opponent  as  his 
target.  It  is  well-known  that  the  number  of  "channels"  in  whioh  a  human  operator  can  think  is  limited. 
Additionally,  the  time  available  to  perform  suoh  an  assessment  is  extremely  short.  Thus  it  seems  un¬ 
likely  that  a  pilot  would  really  select  the  "best"  target.  This  consideration  immediately  leads  to  the 
assumption  of  a  random  target  selection  logio.  A  reasonable  target  selection  logic  probably  lies 
somewhere  between  the  two  extremes. 

There  does  not  seem  to  be  a  way  out  of  the  dilemma,  because  of  the  difficulty  of  modelling  human  behaviour 
and  decision  making  under  conditions  of  very  high  physical  and  mental  stress.  For  obvious  reasons,  there 
cannot  be  a  single  "correct"  target  selection  logic. 

In  this  situation  we  took  the  usual  operational  analysis  approach  of  trial  and  error.  We  mads  a  sensitivity 
analysis,  and  implemented  and  tested  different  target  selection  logics.  Fortunately,  the  overall  results 
indicated  that  -  although  different  logics  resulted  in  more  or  less  different  absolute  results  of  single 
simulated  air  combats  -  the  trends  extracted  from  a  large  number  of  simulation  runs  tend  to  be  independent 
of  the  logic  chosen  and  other  factors  such  as  force  ratio,  formation  build  up,  missile  performance,  and 
IFF  situation  seem  to  be  of  higher  importance  than  an  "optimum"  target  selection  which  is  in  any  way  un¬ 
curtain. 

The  combat  manoeuver  logic:  The  combat  manoeuver  logic  implemented  .is  comparable  to  the  equivalent  parts 
of  well-known  and  well-reputed  one-versus-one  models.  Depending  on  relative  geometry  and  weapon  per¬ 
formance,  one  of  a  suite  of  offensive  or  defensive  manoeuvers  is  selected  against  the  current  target. 

Due  to  the  target  selection  logic  implemented,  target  switching  may  occur  during  a  specific  manoeuver. 

In  this  case  the  manoeuver  is  interrupted  and  another  manoeuver  is  initiated  against  the  new  target. 

In  addition,  specific  taotics  for  the  delivery  cf  medium  range  air-to-air  missiles  were  Implemented  at  the 
request  of  a  NATO  Working  Group.  These  tactics  include: 

-  The  extension  tactic  for  dslivering  medium  range  semi-active  missiles 

-  Stand-off  tactics  for  delivering  fire-and-forget  missiles. 

The  missile  in-range  computation:  At  regular  time  intervals  the  program  checks  the  firing  opportunities 
for  each  aircraft  In  the  game,  A  missile  may  be  fired  if  all  the  following  conditions  are  fulfilled 
concurrently: 


-  Seeker  head  is  locked-on  to  the  target 

-  Look  angle  to  target  is  smaller  than  the  off-boresight  capability  of  the  missile 

-  Target  is  within  kinematic  range 

-  Turning  rate  of  line-of-sight  is  smaller  than  the  maximum  slew  rate  of  the  seeker  head 

-  Target  has  been  identified  as  being  hostile. 

Seeker  head  lock-on  range  may  bo  described  as  a  function  of  system-dependent  and  target-dependent  parameters, 
for  example,  thrust  setting,  speed,  altitude,  and  aspect  angle  for  an  infrared  seeker  head,  or  radar  cross 
section,  which  may  be  dependent  on  the  aspect  angle  for  radar  seeker  heads. 

A  simple  method  of  identification  is  simulated!  an  aircraft  is  considered  to  be  identified  if  any  other  of 
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its  opponent  aircraft  manages  to  close  in  to  a  distance  smaller  than  the  identification  range  specified, 
in  this  way-,,  cooperative  tactics  for  visual  identification  can  be  simulated:  the  first  fighter  Identifies, 
the  second  fighter  shoots.  Alternatively,  the  identification  range  may  be  replaced  by  a  set  of  curves  of 
probabilities  of  identification  as  a  function  of  distance  to  target.  The  kinematic  range  of  a  missile  is 
input  as  a  table  dependent  on  parameters  such  as  aspsot  angle,  speeds,  altitudes,  or  at  a  subroutine  con¬ 
taining  the  software  of  an  aotual  missile  launch  computer  -  if  that  information  is  available  and  releasable. 

The  missile  launch  logic:  If  all  the  necessary  condition*  are  fulfilled  a  missile  or  a  salvo  of  missiles 
can  be  fired  against  the  target.  The  missile  launoh  logic  generates  the  missiles  after  a  given  time  delay 
and  takes  oar*  of  any  appropriate  book-keeping  such  as  a  reduction  in  the  number  of  missiles  an  aircraft 
carries  or  reductions  in  the  mass  and  drag  of  an  airoraft. 

The  missile  fly-out  model:  The  fly-out  of  each  individual  missile  is  simulated  to  a  degree  of  dstail  not 
usually  encountered  in  this  type  of  model.  The  essential  aerodynamic  properties  and  control  limitations 
are  reasonably  well  represented.  As  the  missile  passes  the  target  at  close  distanoe  a  Monte  Carlo 
decision  on  the  target  kill  is  made  on  the  basis  of  the  missile  kill  probability,  whioh  may  be  a  function  of 
and  game  parameters  such  as  relative1  speeds  and  track  crossing  angles.  If  a  target  is  killed  it  is  removed 
from  the  game,  and  surviving  airoraft  continue  searching  and  attacking  new  targets  until  their  fuel  or 
missile  stock  is  depleted.  In  this  case  aircraft  re-link  themselves  to  the  Command  end  Control  Centre, 
whioh  takas  oare  of  their  recovery  and  guides  them  to  their  home  base.  After  landing  on  the  home  base, 
airoraft  are  put  ihto  a  queue  for  reloading  and  refueling,  and  are  available  for  nnw  missions  after  a  given 
time  delay.  Airbase  operations  are  essentially  modelled  as  serving  the  queues  of  aircraft  to  be  repaired 
on  the  base,  to  be  reloaded  and  refueled,  and  to  take  off.  The  appropriate  stooks  of  weapons  and  fuel 
are  retduaed  as  aircraft  are  serviced.  The  sortie  generation  capability  of  the  airbaaa  can  be  made  a 
function  of  tho  damage  level  of  the  airbase,  which  again  may  be  a  function  of  the  number  of  bombers  passing 
over  the  airbase  during  the  game.  Airbase  attack  and  airbase  vulnerability  are  not,  however,  explicitly 
modelled. 

Attacking  side:  The  attacking  side  is  described  in  a  simpler  way  than  the  defending  side  because  the 
ground  environment  and  airbase  operations  are  not  simulated.  Attacking  airoraft  fly  in  formations  of 
up  to  31  airoraft.  These  formations  follow  a  speoified  traok,  laading  to  the  target  to  be  attacked  and 
returning  to  a  "go  home"  point. 

Attacking  airoraft  search  for  interceptors  using  their  on-board  detection  devices  suah  as  A/ I  radar,  FUR, 
or  the  human  eyeball.  If  an  interceptor  is  detected,  escorting  fighters  aaoept  the  engagement  and  start 
to  close  it:  and  attaok.  The  air  combat  logics  for  esoort  fighters  are  identical  to  those  for  interceptors. 
Escorts  try  to  manoouver  themselves  into  firing  position  and  launch  missiles  if  they  can.  The  missile 
fly-out  is  simulated  and  a  Monte  Carlo  decision  on  the  effect  of  a  "missile  explode"  event  is  made. 

Fighter  bombers  try  to  avoid  engagement  by  interceptors  by  running  away  if  an  interceptor  manages  to  come 
oloser  than  a  oritioal  distance.  If  the  interoeptor  still  continues  closing  in,  fighter  bombers  drop 
their  weapon  load  and  try  to  avoid  being  shot  down  by  performing  evasivo  manoeuvers, 

Medium  bombers  are  non-responsive  to  any  attaok  by  interceptors:  they  continue  flying  .on  their  predefined 
track  and  are  easy  targets  for  interceptors  whioh  manage  to  break  through  the  screen  of  escorting  fighters. 

If  esoort  fighters  or  fightel  bombsrs  survive  to  be  engaged  by  interceptors  they  continue  flying  to  thair 
next  trackpoint  or  return  home  if  their  fuel  stock  drops  below  a  critical  value. 

Elements  of  each  formation  may  be  defined  as  jammers.  There  are  provisions  for  three  types  of  jammer: 

-  Escort  jammers  (ESJ) 

-  Self-screening  jammers  (SSJ) 

-  Stand-off  jammers  (SOJ), 

The  effects  of  ESJ  and  SSJ  are  modelled  primarily  by  denying  the  ground  environment  the  capability  of 
counting  the  number  of  targets  flying  within  a  formation.  The  engagement  of  a  jamming  formation  is 
initiated  only  if  the  formation  is  detected  by  at  least  two  sensors  so  that  strobe  triangulation  is 
possible.  Additionally,  detection  ranges  and  kill  probabilities  can  be  made  a  function  of  jamming.  The 
aggregate  effects  of  all  jammers  in  the  game  for  each  sensor  are  determined  for  the  current  line  of  sight, 
so  that  specif lo  sectors  of  sensors  degrade  and  black  out  dynamically  during  the  game.  Burn-through  and 
sidelobe  jamming  are  neglected. 

2.2  Input  Data  Required  lo  Drive  the  Program 

Input  data  are  required  to  describe! 

-  The  scenario 

The  function  and  performance  of  the  Command  and  Control  System 

-  The  aircraft  performance 

-  The  missile  performance. 

All  data  are  input  by  a  special  free-format  input  language  (COMIb),  which  is  very  fast  and  flexible  and 
allows  the  definition  of  scenario,  tactics,  and  performance  to  almost  any  degree  of  detail.  The  input 
file  drives  the  program. 

The  scenario  is  described  by  a  set  of  data  defining  attack  routes  and  threat  formation  build  up.  Several 
airoraft  types  in  different  numbers  can  fly  in  the  same  formation,  and  the  performance  of  each  of  the  air¬ 
craft  type's  has  to  be  defined  separately.  Early  warning  sensors  have  to  be  defined  with  respect  to  their 
position,  detection  capability,  and  terrain  screening.  The  tracking  capability  of  the  system  has  to  be  • 
described  by  maximum  number  of  track  files,  time  delays,  and  tracking  errors.  Allocation  rules  resulting 


in  policy  or  strategic  daciaions  ara  defined  for  tha  Command  and  Control  Systam.  Airbases  ara  dtfintd 
with  raapaot  to  thair  poaition  and  aircraft  sarvicing  and  aortia  generation  capability.  Different 
interceptor  aircraft  types  may  be  deployed  on  different  airbases.  Some  aircraft  may  be  airborne  and 
circling  in  combat  air  patrol  patterns  at  tha  start  of  the  game.  Aircraft  performance  is  described  by 
means  of  drag  and  lift  co-efficiants  and  thrust  as  a  function  of  Mach,  altitude,  thrust  secting,  wing 
sweep  and  so  on.  Initial  fuel  load  and  apacific  fuel  consumption  as  a  function  of  different  flight 
parameters  havs  to  bt  defined.  Each  aircraft  may  carry  up  to  two  air-to-air  miaaila  typos,  tha  per¬ 
formance  cf  which  is  defined  by  tha  acquisition  performance  of  tha  leaker  head  as  a  function  of  system- 
dependent  and  target -dependant  parameters,  thrust  profile,  drag  characteristics,  lateral  acceleration 
capability,  and  and  gam*  affaotivonass.  A  medium  size  scenario  with  a  few  attacking  formations,  several 
sensors,  airbases  end  intarasptor  typea  may  require  between  some  hundreds  end  some'  thousands  of  input 
values  to  bt  defined,  depending  on  the  degree  of  detail  desired  and  tha  laval  of  aggregation  being  played. 

3.  HARDWARE  CONFIGURATION  FOR  RUNNING  THE  MODEL 

The  computer  configuration  is  shown  in  Figure  H.  The  model  resides  in  memory  in  the  CDC  CYBER  173  com¬ 
puter.  A  graphics  terminal  is  oonnactad  tc  tha  CYBER  173.  During  execution  of  the  model  the  position 
of  all  participating  combat  units  ia  displayed  on  tha  screen  of  tha  graphic!  terminal  at  chosen  time 
intervals  (for  example,  every  tan  gams  seconds  the  positions  of  the  combat  units  are  displayed).  The 
user  can  monitor  the  progress  of  tha  game  and  control  tha  running  of  the  ..model. 

A  sat  of  output  commands  enables  the  following  information  to  be  stored  on  diso  or  given  aa  listed  output 
of  tha  running  simulations 

(1)  History  of  ths  game.  The  history  contains  X-Y  locations,  hsight,  spied  components, 
acceleration  components  and  variables  of  which  tha  valua  changes  in  the  oourts  of 
the  gams,  e.g.,  fuel  on  board,  number  of  missiles  available,  number  of  missile* 
fired ,  name  of  the  target . 

(2)  Results  of  the  simulation  run.  Contents  ares  name  of  an  airoraft  which  launched 

a  missile,  nama  of  the  target,  name  and  type  of  the  miaaila,  speeds  of  tha  launching 
aircraft  and  the  target,  look  angles,  closing  spaed  and  thrust  levels  at  time  of 
launah,  etc.  The  results  include  the  outcome  of  a  "missile  explode"  event,  indicating 
whether  it  was  a  target  kill  and  if  not  whatf  was  the  reason. 

(3)  Debugging  and  testing  aids.  They  contain  memory  dumps,  check  listings  and  maps. 

Output  stored  on  disc  can  be  post-processed  and  statistical  analyses  with  plotted  information  may  be 
made  automatically  or  oontrolled  through  an  output  control  terminal. 

Another  command  forces  the  running  model  to  writs  history-like  information  on  a  magnetic  tape.  This 
taps  can  be  processed  and  run  by  STC'a  graphics  facility  to  give  a  detailed  view  of  the  gams  on  a  large- 
sareen  three-dimensional  graphics  display  similar  to  a  moving  ploture.  Additionally,  the  graphics 
faoility  can  be  driven  by  the  CDC  computer.  ( 

Example  output  generated  by  the  model  control  graphics  terminal  is  presented  in  Figures  B  -  7  which  show 
a  sequence  of  throe  hardoopies  taken  from  the  terminal  at  several  game-minute  intervals.  This  run 
simulated  an  attack  by  approximately  1B0  aircraft  at  low  altitude  in  close  formation  l  the  airoraft 
diverted  to  various  air  defence  installations  in  TWOATAF.  Airborne  early  warning  was  provided  by  an  E-3A 
aircraft  circling  over  the  Netherlands.  Fifteen  CAP  patterns  with  a  manning  of  two  aircraft  each  wsre 
deployed  over  the  area.  Aircraft  positions  are  displayed  every  ten  seconds.  The  information  which  can 
be  extracted  from  these  hardcopios  is  limited  but  they  Illustrate  the  capability  of  the  model  to  handle 
theatre-level  analysis  and  still  simulate  each  sensor,  airoraft,  and  missile  to  almost  any  desired  degree 
of  detail. 


4.  SOFTWARE  TECHNIQUES  USED 

The  COMO  simulation  system  was  used  for  the  implementation  of  the  interceptor  model  because  of  its  highly 
flexible  and  efficient  input  and  computer  resource  management  system.  COMO  is  a  combat  simulation  system 
developed  by  the  SHAPE  Technical  Centro  and  ie  a  tool  for  the  generation  of  critical-event  combat 
simulation  models. 

The  framework  of  the  COMO  simulation  system  includes  the  features  which  are  common  to  all  simulations  of 
this  type.  These  features  include  book-keeping,  sorting,  scheduling,  and  provision  of  functions  which 
are  frequently  used  in  combat  simulations,  such  as  searching  for  targets,  weighting  of  detsotad  targets, 
calculation  of  relative  speedn  and  geometry,  and  3o  on.  Thus,  the  designer  of  a  combat  simulation  program 
does  not  need  to  implement  these  common  features  each  time  he  writes  a  simulation  program.  He  can  concen¬ 
trate  on  the  essential  features  of  the  weapon  systems  simulated  provided  ha  ensures  that  the  interface 
between  the  weapon  system  simulated  and  the  COMO  frame  functions  as  designed.  The  routines  describing 
a  weapons  system  must  be  written  in  FORTRAN,  according  to  specific  rules  whioh  permit  tha  weapons  deck 
routines  to  bo  read  in  as  input  and  processed  by  a  run  file  assembly  processor.  The  processor  generates 
the  code  that  has  to  be  added  to  the  COMO  frame  to  give  a  complete  simulation  program.  This  rather 
complicated  process  of  generating  a  simulation  program  io  fully  automated,  and  the  designer  of  the  program 
has  merely  to  insure  that  his  weapons  system  description  conforms  to  the  conventions.  This  process  is 
shown  in  Figure  8. 

Although  COMO  has  been  divided  into  several  overlays  to  save  storage,  a  medium-size  weapon  deck  and  a 
scenario  with  a  few  hundred  combat  units  participating  simultaneously  in  the  game  would  require  a  computer 
with  a  memory  size  well  above  150K  memory  locations.  It  was  recognised  early  in  ths  development  of,  the 
COMO  program  that  the  vast  amount  of  input  data  required  to  define  a  scenario  and  the  variables  required 
to  describe,  update,  and  integrate  the  changing  properties  of  combat  units  participating  in  the  game 


would  oooupy  a  large  proportion  of  the  memory  available  and  would  limit  the  simulation  capability  of  the 
software  system. 

An  example  may  illustrate  this  problem:  assume  that  one  of  the  changing  variables  describing  a  combat 
unit,  say,  an  aircraft,  is  a  flag  whioh  is  set  if  this  aircraft  is  attacking  a  target  and  reset  if  the 
aircraft  is  no  longer  attacking  a  target.  Thie  flag  ia  a  twitch  which  can  be  represented  by  one  single 
bit.  In  normal  FORT RAM  coding  the  flag  would  require  one  single  word  of  memory  comprising  SO  bits 
(for  a  CDC  computer).  This  is  a  memory  utilisation  of  only  1.7%. 

To  keep  storage  requirements  within  reasonable  limits,  an  extensive  pack  and  unpack  faoility  was  included 
in  the  OOMO  simulation  system  and  this  fsoility  resultsd  in  a  significant  reduction  of  memory  requirements. 
Input  data  and  data  changing  during  the  game  are  stored  (packed)  several  items  per  word,  according  to 
certain  packing  rules  whioh  have  to  be  defined  for  every  variable.  The  unpack  procedure  extraota  items 
according  to  the  same  rules. 

Packing  and  unpacking  adds  to  the  overhead  cf  the  simulation  program  and  of  course  requires  run  time. 

To  keep  the  additional  run  time  to  a  minimum,  pack  and  unpack  routines  are  written  in  Assembly  Code,  and 
are  optimised  for  minimum  overhead. 

An  example  taken  from  the  COMO  interceptor  model  illustrates  the  reduction  in  memory  requirement  when 
paoking  and  unpacking  is  used  as  compared  to  conventional  Btoring  of  data  items  in  arrays. 

In  the  interceptor  model  an  airoraft  is  described  by  53  data  items  whioh  may  change  during  the  game. 

These  53  data  items  are  packed  into  8  words.  In  normal  FORTRAN  coding  53  items  require  53  words. 

The  advantage  of  packing  is  rsduoed  by  the  overhead  required  for  paoking  routines.  Figure  9  shows  a 
comparison  of  the  memory  size  required  for  storing  the  53  changing  properties  of  an  airoraft  as  simulated 

in  the  interaeptor  model  for  normal  FORTRAN  ooding  and  for  paoking  in  COMO,  as  a  function  of  the  number 

of  combat  units  in  the  game.  A  bias  of  2200  words  for  paoking  overhead  is  taken  into  aooount.  It  is 
assumed  that  ail  the  FORTRAN  coding  would  be  done  as  efficiently  as  in  the  COMO  system.  Figure  9  shows 
that  paoking/unpaoking  becomes  economic  if  there  are  more  than  55  airoraft  involved  in  an  air  oombat 
simulation. 

5.  VALIDATION  OF  THE  MODEL 

Validation  of  auoh  a  compJox  model  is  extremely  difficult  and  has  to  be  split  into  several  parts: 

(1)  Debugging  of  the  program 

(2)  Validation  of  the  submodels  which  describe  automatic  sy sterna 

(3)  Validation  of  the  submodels  which  describe  systems  w.ith  human  interaction 

(4)  Validation  of  the  complete  modal  with  all  submodels  playing  together  dynamically. 

5.1.  Debugging 

The  debugging  of  the  program  is  an  obvious  but  non-trivial  job.  The  task  of  debugging  is  to  ensure  that 
the  program  behaves  as  intended  by  the  designers  of  the  program,  All  the  usual  debugging  methods  have 
been  applied  to  the  program  and  the  designers  of  the  program  are  quite  confident  that  the  program  is 
mature.  However,  it  has  been  argued  in  the  literature  that  there  is  no  way  of  proving  that  a  non-trivial 
program  is  totally  bug-free.  Consequently,  we  cannot  prove  that  there  in  no  bug  hidden  in  the  program. 

5.2.  Validation  of  Submodels  Describing  Automatic  Systems 

The  validation  of  submodels  describing  automatic  systoms  is  a  relatively  easy  task.  The  response  of  the 
modelled  system  is  compared  with  that  derived  from  real-life  measurements  or  from  detailed  models  that 
have  already  been  validated.  The  following  subsystem  models  have  been  validated  I 

-  Sensor  operations 

-  Traok  build-up  and  maintenance 

-  Airbase  operations 

-  A/ I  radar  detection 

-  Airoraft  mission  profiles 

-  Airoraft  response  on  manoeuvers  initiated 

-  MiBsils  in-range  computation 

-  Missile  fly-out. 

Additionally,  the  function  of  visual  detection  and  identification  was  validated  in  that  manner. 

5.3  Validation  of  Submodels  Describing  Systems  Involving  Human  Interaction 

The  validation  of  submodels  describing  systems  with  human  interaction  is  a  far  more  difficult  job. 

Human  decision  making  varies  for  each  individual  and  there  is  no  way  of  establishing  a  single  "correct" 
algorithm  describing  human  response,  Nevertheless,  human  decision  making  ban  to  be  simulated  in  the 
type  of  model  wo  are  describing  here  and, the  best  we  can  achieve  is  a  "reasonable"  algorithm  found  by  trial 
and  error. 

The  areas  in  whioh  human  decision  making  becomes  very  critical  in  an  eir  defence  system  are: 

-  The  air  resource  alloaction 

-  The  airborne  target  selection  and  air  combat  manoeuvering , 

When  air  resource  allocation  algorithms  warn  tested  it  was  found  that  the  consistent  application  of  the 


algorithms  to  minimist  targst  penetration  may  lead  to  engagements  of  low  effectiveness  and  to  high 
attrition  rates  because  of  lack  of  coordination  in  the  timing  of  the  withdrawal  of  interceptors  from 
different  combat  air  patrol  patterns  or  the  scrambling  of  aircraft  from  different  airbases.  This 
absence  of  coordination  means  that  single  interceptors  or  single  pairs  of  interceptors  sequentially 
engage  a  numerically  superior  threat,  with  disastrous  results.  Obviously,  a  mass  attaok  should  be 
countered  by  a  mass  defence. 

As  the  tests  show  the  low  effectiveness  of  a  poasibls  air  rasouroe  allocation  subsystem  the  next  step  is 
to  consider  the  manual  ovarrlda  capability.  Very  little  is  known  about  how  a  military  battle  manager 
would  allocate  limited  resourced  in  the  presence  of  uncertainty.  Tha  only  way  to  find  out  is  to  make 
experiments  with  the  man-in-tha-lcop,  and  thia  is  in  fact  the  main  step  in  the  model  and  facility 
devalopmant  dasoribed  in  tha  final  part  of  this  papar. 

The  problems  of  airborne  target  selection  and  air  combat  manoeuver  selection  were  discussed  earlier. 

The  implementation  of  reasonable  algorithms  was  performed  by  modal  design  and  validation  with  support 
provided  by  experienced  weapon  operators. 

A  comprehensive  pseudo -three- dimensional  graphics  paokage  was  dsvelopad  at  STC  which  mads  it  poaaible  to 
visw  a  simulated  air  combat  as  a  moving  picture  from  any  point  in  ipao*  including  the  oockpit  of  any  air¬ 
craft  involved  in  tha  oombat.  In  this  way,  experienced  pilots  were  exposed  to  the  display  of  almulattd 
air  combats  and,  based  on  their  oommants ,  the  algorithms  and  tactics  were  modified  until  a  satisfactory 
state  of  modal  development  was  raaohad.  Several  iterations  of  this  prooess  were  made.  The  graphics 
display  system  was  used  as  a  communications  link  between  fighter  pilots,  tho  computer,  tha  model 
designers  and  so  served  as  a  modal  design  tool.  Examples  of  hardcopies  taken  from  the  display  are  given 
in  Figures  10-24, 

5.4.  Validation  of  the  Complete  Model 

The  validation  of  the  oomplete  model  has  not  yet  proved  possible  beoauss  of  our  lack  of  knowledge  of. 
human  decision  making  with  respeot  to  resource  allocation.  It  was  possible,  however,  to  validate  a  major 
part  of  the  model  by  a  comparison  of  its  response  with  data  oolleoted  during  a  major  US  flying  trial. 

Output  produced  by  the  multiple  air  combat  part  of  the  model ,  including  submodels  for  airborne  deteotion 
and  identifioation,  target  selection,  manoeuvering ,  missile  launoh,  missile  fly-out  and  missile  end  game 
effeotiveness,  waB  compared  with  statistical  data  obtained  from  a  major  US  live  flying  trial.  The 
correlation  was  excellent, 

However,  evan  excellent  correlation  is  no  proof  that  the  model  is  "oorreot".  It  is  merely  an  indioation 
that  the  model  response  is  "reasonable"  and  that  this  part  of  the  model  is  mature  enough  to  be  used  for 
production  runs, 

6.  FURTHER  DEVELOPMENTS  OF  THE  COMO  INTERCEPTOR  MODEL 

The  COMO  interoeptar  model  has  been  used  intensively  during  the  last  two  years  -  approximately  8000  air 
combat  simulations  wore  performed  in  total  -  and  the  main  strong  and  weak  points  have  been  identified. 

As  a  result  of  this  experience,  we  decided  to  split  future  development  into  two  direotionsi 

(1)  Higher  degree  of  detail  and  more  resolution  at  the  expense  of  aomputer  resource 
requirements 

.  (2)  Higher  degree  of  aggregation  at  tho  expense  of  resolution. 

The  more  detailed  model  will  be  a  development  of  the  multiple  air  combat  part  of  the  interceptor  model. 

It  will  be  tailored  to  study  weapon  systems  effectiveness  and  new  tactics  adapted  to  new  weapons  systems. 

The  more  highly  aggregated  model  will  be  tailored  to  reduce  the  weak  points  identified  in  our  current 
air  defence  system  simulation  capability.  As  explained  beforo,  the  weaknesses  identified  are  not 
necessarily  model  deficiencies,  but  are  due  to  our  lack  of  knowledge  of  the  behaviour  of  the  individual 
human  elements  of  the  Command  and  Control  System.  The  extensions  being  developed  should  give  SHAPE  and 
ourselves  a  better  understanding  of  some  of  the  operational  problems,  especially  in  relation  to  the  human 
engineering  aspects  encountered  in  current  and  future  Command  and  Control  Systoms.  The  program  and  model 
structure  will  be  left  unchanged!  it  has  proven  its .flexibility  and  capability.  Some  modules,  however, 
will  be  modified  and  simplified  and  now  modulos  will  bo  added. 

As  the  ourrent  model  Is  extended  to  simulate  a  real  air  defence  system,  the  ground-based  air  defenoe  will 
be  included  by  the  incorporot ion  of  medium-range  and  long-range  surface-to-air  missile  systems  such  as 
NIKE,  I  HAWK,  and  PATRIOT, 

Low-altitude  short-range  air  defences  (SHORADs)  which  include  guns  and  short-range  SAMs  such  as  ROLAND 
and  CHAPARRAL  will  be  described  at  the  appropriate  level  of  aggregation. 

IFF  will  be  simulated  as  realistically  as  possible  and  fratricide  will  be  simulated  for  casBS  of 
erroneous  identification.  The  very  detailed  model  of  the  manoeuvering  of  oach  Individual  aircraft  and 
missile  in  olo3e  combat  is  hoped  to  be  replaced  by  a  more  aggregate  model  designed  by  the  Institute  for 
Defence  Analyses,  US. 

ECM  simulation  will  be  further  improved  and  will  also  be  applied  against  communications  links,  resulting  in 
increased  transmission  time  or  loss  of  mossa-e,  depending  on  the  signal/jamming  ratio  of  the  ourrent  link- 
jammer  geometry. 

For  low-altitude  attacks,  the  effects  of  terrain  line-of-sight  interruption  may  be  important.  A  terrain 
preprocessor  will  be  U3ed  to  compute  visibility  patterns  for  oach  individual  sensor  in  the  game  by  direct 
access  of  digitized  terrain  data. 


Decision  logics  for  implementing  strategies  will  be  based  on  algorithms  similar  to  those  already 
Implemented  or  subject  to  manual  override  by  graphical  input/output.  As  the  game  progresses  decisions 
will  be  based  on  available  information  and  available  communication  links.  In  the  interactive  version, 

available  and  confused  information  will  be  presented  at  runtime  in  the  form  of  an  air  picture  at  a 
graphics  display  and  onu  or  more  alphanumeric  displays  will  provide  information  on  the  status  of  the 
defence  force.  Decisions  on  resource  allocation  will  be  made  on  the  bails  of  information  availabla  to 
a  battle  manager  sitting  in  front  of  a  screen  and  controlling  his  forces.  The  whole  syetem  will  be  set 

up  as  a  one-sided  wargaming  system  whan  one  battle  manager  controls  his  own  forces  in  the  best  way  he 
can  to  defeat  an  attacker  with  a  predefined  strategy  which  is,  however,  unknown  to  him. 

This  wargaming  version  of  the  air  defanae  system  simulation  will  be  yet  anothor  development  phaee  end 
experience  gained  in  this  phase  is  expected  to  leed  to  e  better  underetanding  of  reasonable  strategy  and 
resource  allocation  algorithms,  and  possibly  to  the  design  of  better  algorithms. 

The  most  valuable  application  of  the  wargaming  modal  might  be  the  study  of  man-machine  interfaces  in 
Command  and  Control  Systems  by  the  measurement  of  the  performance  of  different  battle  managers  when 
playing  with  different  options  of  command  and  oontrol  systems. 

7.  FINAL  REMARKS 

A  model  possessing  unusual  flexibility  and  growth  potential  was  established  at  SHAPE  Technical  Centra. 
This  model  contains  as  a  submodel  the  first  operational  multiple  air  combat  simulation  model  available 
within  NATO.  The  program  has  been  used  during  the  last  two  yoars  to  study  the  combat  effectiveness  of 
a  set  of  current  and  possible  future  air-to-air  missile  systems  and  associated  tactics.  The  main 
operational  and  technical  factors  determining  the  outcome  of  air  combats  were  identified  and  measures 
recommended  which  would  -  when  adopted  -  alleviate  some  of  the  major  problems  associated  with  airborne 
air  defence  operations  in  Allied  Command  Europe. 

The  experience  gained  during  the  last  few  years  emphauises  the  relevance  of  the  human  element  with  its 
unequalled  pattern  recognition  capability.  Consequently ,  modal  evolution  and  application  in  the  near 
future  will  oentre  around  this  focal  point.  Air  defence  system  simulation  must  give  the  human  element 
the  aredit  it  deserves  in  a  oomplex  and  quickly  changing  environment . 


Figure  i!  Conceptual  model  structure  of  the  defending  side 


Figure  2 1  Conceptual  nodal  structure  of  the  attacking  aide 
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Grtti  size  is  two  nautical  miles.  Game  time  is  displayed  in  upper  right  corner  of  display 
area 
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SIMULATION 


WITHIN  MILITARY  AIR  DEFENCE  SYSTEMS 
FOR  TRAINING  AND  EVALUATION 


Hans-Jochen  Wunschmann 
NATO  Programming  Centre 
Blaarstraat  99 
B-3700  Ttingeren/Belgium 


SUMMARY 

Within  automated  air  defence  eyatema  "simulation"  ia  uiad  to  support  "war  Rami  tig"  and  ai  a  technique  to 
study  complex  operational  (real-time)  software  function*. 

In  thl*  context  simulation  ha*  the  rather  specific  meaning  of  the  generation  of  a  synthetic  radar  picture 
which  is  input  into  the  air  defence  lystem's  hardware  and  processed  by  its  software,  , 

Such  simulation  systems  enable  war  gaming  for  operational  training  and  evaluation  purposes  for  which  the 
use  of  live  aircraft  is  excluded  intelligence,  cost,  safety  or  geographical  reason*. 

To  generate  the  simulated  radar  picture,  which  forma  a  variable  model  of  the  current  eir  threat,  computer 
proSrsms  separate  from  the  system' a  real  time  software  are  involved. 

These  programs  utilise  flight-path  models  using  known  aircraft  performance  characteristics,  as  well  ai 
modelling  of  weather,  terrain  and  radar  rcctiver  characteristics . 

The  different  phases  of  war  gaming  within  air  defence  systems  are  described,  and  finally  the  question  of 
analysis  and  performance  evaluation  programs  to  permit  the  assessment  of  the  performance  of  the  system  or 
its  components  achieved  on  a  simulated  scenario  compared  to  that  expected  is  addreaaad. 
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INTRODUCTION 


1.  Within  automated  air  defence  systems  "simulation"  it  utilised  to  support  "war  gaming"  at  different 
tactical  levels  of  the  air  defence  organisation.  In  line  with  the  theory  of  games  the  combat  between 
air  attack  and  air  defence  can  be  viewed  as  a  two-person-zero-aum  game.  In  principle  there  is  one 
attacker  who  seeks  the  greatest  possible  gains  (the  destruction  of  targets)  and  a  defender  who  attempts 
to  make  these  gains  ss  smsll  as  possibls.  Ths  sttacksr  has  a  large  choice  of  possibilltiei  he  muat 
choose  i 

-  the  targets  for  ths  sttsck  | 

-  the  typa  and  number  of  aeroplane!  ; 

-  the  flight  profile  (manoeuvres) ,  route  and  flight  tactic  ; 

-  the  weapon  yields  |  and 

-  ths  time  of  attack. 

The  defender  hai  a  more  limited  choice  of  possibilities,  he  can  select  t 

-  the  location  of  weapon*  and  their  taatics  ; 

-  the  distribution  of  his  difence  resources  among  the  targets  subject  to  attack  ; 

-  the  amployament  of  hie  resources  over  time. 

2.  The  purpose  of  gaming  in  air  defence  i*  to  sarva  i 

-  as  a  training  and  indoctrination  technique  | 

-  ai  an  analytic  tool  by  which  different  concept*  or  plane  can  he  investigated  |  and 

-  aa  an  evaluation  tool  for  operator  and  aystem  performance. 

The  "rule*"  for  the  games  are  normally  the  current  operational  procedural  supplemented  by  acenario 
depandent  additional  information,  (i.a.  the  enemy1*  and  own  forces  location,  capabilities,  intention 
as  wall  aa  the  development  of  the  political  and  military  aituation  which  load*  to  the  conflict  to  ba 
"playad") .  In  principle  the  games  ere  run  in  a  "eloasd-plsy  technique",  where  uncertainty  and  intelli¬ 
gence  are  included,  and  the  play  is  controlled  and  monitored  by  a  "Dirooting  Staff". 

3.  Due  to  certain  peculiarities,  the  "game*"  playad  in  our  present  air  defence  system  appear  somewhat 
differant  than  th*  standard  application  of  the  theory  of  games.  Ths  moat  important  ones  to  be  noted  are  i 

-  The  expected  course  of  action  of  the  attacker  is  simulated  by  s  predetermined  computer  generated  string 

of  events  forming  a  model  of  the  air  threat  supplementad  with  chronological  oriented  script*  of  tacti¬ 
cal  action  events  |  . 

”  The  defender  utilissi  th*  normal  oparational  hardwar*  and  software  function*  of  tha  air  dafenca  system 
to  react  to  th*  threat  in  accordance  with  current  oparational  plana  and  directive*.  (Fig.  1). 

It  should  be  noted  aa  well  that  air  dafenca  paraonncl  uaa  th*  term  "exareiaa"  instead  of  "war  game",  a 
"game"  using  simulated  inputs  is  called  synthetic  air  defence  exercloe  (BYNADEX) . 

4.  Th*  type  of  analysis  to  ba  performed  after  the  "game"  is  determined  by  it*  objective  or  purpose  and 
the  tactical  level  of  the  "player*",  In  general  an  outcome-oriented  analysis  will  be  performed  which 
can  be  regarded  aa  a  aumnwry  of  "what  happened"  in  th*  couree  of  the  war  game.  Tha  event*  compiled 

will  aarve  as  a  data  base  for  operator  and  ayatam  oriented  performance  evaluation  and  to  draw  eoncluaiona 
which  feed  back  into  the  operational  environment  and  into  the  objective*  of  follow-on  gaming. 

SIMULATION  SUPPORT  FOR  WAR  GAMING 

5.  Within  automated  air  defence  eyitema  "simulation"  has  the  rather  specific  meaning  of  tha  generation 
of  e  synthetic  air  situation  upon  which  "players"  from  the  planning  Rnd  tasking  level  down  to  th* 
execution  level  of  the  organiaation  may  take  the  same  decisions  and  actions  as  for  a  reel  sir  situation, 
and  which  will  respond  to  these  action*  similarly  to  th*  real  aituation.  In  contrary  to  tha  standard 
Application  of  simulation  the  system  to  he  manipulated  is  retained  and  not  replacad  by  a  software  model. 
The  input*  to  thia  aytem,  however,  are  simulated  and  represent  a  dynamic  modal  of  tha  air  threat  In  tha 
form  of  a  synthetic  radar  picture.  One  may  look  at  this  configuration  aa  a  "People  and  Computer  Model", 
because  both  people  and  computer  software  and  hardware  are  embedded  in  an  overall  model  comprising  the 
own  air  defence  system  and  its  air  asssta  as  wsll  as  the  opposing  sir  threat.  (Fig.  2). 

6.  The  primary  purpose  of  simulation  In  the  air  defence  system  ia  to  play  there  operational  scenario* 
which  cannot  be  exercised  during  peacetime  live  activities  and  to  exercise  the  ayatam  at  low  coat. 

Fig,  3  shows  a  broad  example  scenario. 

In  peacetime  exercising  of  real  air  dofehce  operation*  are  limited  in  number,  duration,  magnitude,  and 
contain  many  artificialities.  Particular  limitation!  are  due  to  i 
national  regulations  and  reatrictiona  (i.e.  limited  supersonic  flying,  prohibited  geographical  areas, 
air  traffic  control  aspects)  j  roar,, 

-  air  aafety  constraints  s 

-  peacetime  restrictions  in  uatng  electronic  counter  measures  (ECM)  | 

-  impact  of  variables  which  cannot  be  controlled  (i.a.  weather,  equipment  atatus)  | 

-  limited  availability  of  aeroplanes  (to  represent  the  attacker)  | 

-  coat*  involved,  and 

-  aecurity  aapects. 

These  constraint*  mean,  that  war  game*  utilising  the  "real  world"  have  a  limited  value  with  regard  to 
operational  analysie  and  aystam  training  i.e.  i 

-  a  model  of  the  air  threat  (attacker)  and  the  own  situation  and  capabilities  (defender)  composed  of  real 
elements  does  not  cover  the  expected  aituation  to  the  required  extent  I 

replays  of  live  games  are  expensive  and  will  not  reproduce  the  planned  scenario  to  the  extent  required 
due  to  various  variables  which  cannot  be  controlled. 


wmmwmmmm-- 

-  "nought  Mth*Parstmt#red  before  dleplay  and  proceeding  through  comprehen.ive  model*  of  th«  real 

.  is^sratiar^  8s.iiM--.i-uu-  plot. «- 

«*  b  function  of  rtdar  cro»s-**ction,  rang*  and  radar  r*c*iv*r  characteristic*  , 

-  «l«otronic  jamming  and  chaff  atfa  raaliitically  correlat*d  with  tha  appropriata  simulated  jammar 

!nCi!Jlutif  nUht0pSn«iybr5roi;iSS  to  rafl.ct  th.  currently  known  or  expected  flight  profit.. , 
llJal^l!  P«fii£cS  ch.«".;'.tici,  approach  and  attick.  t.ct  i=.  nnd  "targeting"  of  NATO  and  non- 

-  (limulate^NATO*  interceptor  type  aircraft  utili.ing  model,  of  th.ir  performance  charactari.tic.  can  b. 

manoeuvred  againat  the  threat  t  ,  . 

-  *11  *imulitad  data  inputa  ara  processed  and  reacted  upon  aa  for  raai  live  aaca,  « 

It  .hould  be  noted,  however,  that  the  .inwlation  ayat.ra  procured  i.  mainly  doigned  to  train,  «d 

meaaure  the  internal  flow  of  tactical  event,  and  operational  function,  of  the  NATO  air  defence  grouna 
environment.  The  efficiency  of  the  weapon,  system.  employed  for  < defen.ive  act  on.  !•  i not  inoludad  tU 

•imulation  oroce...  In  addition  to  realism  th*  eir  track  parameter  consideration*  are  very  important  tor 
enalyeie  pu?po.e.  eincc  they  deal  with  detection  and  tracking  capabilities  within  the  air 

function  of  th*  tystem  and  direct  attention  upon  available  reaction  time..  To  avoid  design  .implific 
tiona  that  degrade  realism  and  thwart  valid  analyaia  and  evaluation  of  war  gaming  the  huge  amount  of  data 
involved  is  processed  by  an  appropriate  computer  program  developed  for  the  M*n**  th*  " 

ronment  (NADQE)  eyetem  which  in  addition  reduce,  th.  amoung  of  manual  labout  involved  in  producing  th* 
simulated  Inputs  and  analyst,  .result. . 

8.  It  mu.t  be  stressed  that  aimulatlon  i.  an  important  vehicle  for  analysing  and  aveluating  ait*  or  »y»- 

tem  performanc*.  Thlk  requires  standard  mieeion  daaign  with  controlled  environmental  condition*  and 
■upplemented  with  a  variety'  of  "stress  input."  in  .eeordanc.  with  th*  current  training  objective*. 
Performance  observed  dufcing  „ar  games  of  equivalent  difficulty  can  then  be  compared  ae  a  measure  . 

improvement  or  degradation.  Depending  on  aim,  .cope  and  volume  of  the  plunned  v*r  game  end  the  eomman 
level)  Involved  the  information  needs  of  the  vavioui  users  for  anolyais  purpoe*.  are  different.  The 
exercise  designer.,  therefore,  mu.t  consider  th.  analy.ia  objectives  and  consequently  the  methodology 

of  the  anelysls  end  evaluation  program*.  The  .cope  nnd  configuration  of  th*  simulated  air  situation 
amt  the  ■imulated  operational  environment  mu it  be  tailored  to  the  training  and  analysis  requirement!*. 

The  aim  of  expanding  the  scope  in  to  increase  the  number  of  actual  Information  and  control  inputs  to 
be  profttSRcd*  The  larger  war  games  in  scope  and  configuration,  the  less  the  requirement  for  simulator 
personnel ,  i.c.  tho.e  who  ara  required  to  simulate  tha  action,  and  reapcn.es  of  the  system  element, 
that  nr*  wot  directly  involved  in  the  exerciee.  In  a  largo  scale  war  game,  the  only  simulated  input* 
are  the  senior  data  and  event*  (.tree,  input.)  as  injocted  from  an  incident  list  prepared  by  the  exerciee 
planners. 

THU  NAPPE  SYSTEM  AND  ITS  ASSOCIATED  SIMULATION  HARDWARE  AND  SOFTWARE 

9,  The  MATO  Air  Defence  Around  Environment  system  together  with  the  national  system*  of  Franca  and  the 
United  Kingdom  form  the  air  defence  system  for  the  whole  of  NATO  Europe  (Fig.  4).  This  complex  .yetem 
consists  primarily  of  l 

-  radars, 

-  computers, 

-  electronic  data  transmission  facilitiea,  ami 

-  communications.  .  ,  , 

About  eighty  sites  are  netted  with  the  data  link,  for  air  track  data  exchange  and  following  a  continuous 
North-South  sweep  from  Norway  through  Oermany  to  Turkey.  This  syitsm  is  directed  by  the  different  NATO 
Air  Defence  Command  level*  and  provides  continuouely  t 

-  a  recognised  (identified)  ovarell  air  picture,  and 

-  capacities  for  the  control  and  monitoring  of  air  defence  weepone. 

The  eequenc*  of  functional  and  operational  avents  performed  ere  ehown  in  Fig,  5.  Included  in  the  hetdwer* 
and  software  functions  of  tha  NADOE  sites  are  simulation  facilities.  These  eupport  reelietic  wer  geming 
in  the  form  of  exerciees  ueing  eimuUtwd  inputs.  Th*  wer  games  mey  range  in  scope  from  eite  centred 
exercises  to  a  system-wide  scenario  involving  the  appropriate  tactical  command  and  control  element*. 

With  regard  to  system-wide  war  gaming  it  must  be  pointed  out,  that  herdwars  and  operational  aoftware 
are  specific  to  the  particular  air  defence  system  for  which  they  are  procursd.  The  programs  avsileble 
in  the  NADQE  system  to  generate  the  simulated  sir  picutre  are  to  s  great  extent,  Independent  of  tha  par¬ 
ticular  automated  system  since  it  is  often  a  requirement  that  th*  simulated  air  situation  be  dieplayed 
simultaneously  with  units  with  differnet  systems. 
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10.  Tha  NADGE  aimulntion  System  comprise*  three  major  elements  i 

-  off-line  jottwarc  to  generate  simulated  air  track  data,  jamming  and  chaff  on  magnetic  tape,  which  ie 
input  to  the  hardware  for  war  gaming  i 

-  hardware  to  produce  simulated  radar  reeponoea  on  the  operator's  data  display  consoles,  route  the 
simulated  data  into  the  main  processor  and  control  the  simulation  functions  ; 

-  on-line  (real-time)  simulation  software,  which  tima-aharss  the  central  processor  with  the  operational 
(real-time)  eoftwere  end  in  conjunction  with  the  herdwere  processes  the  simulated  date  inputs. 

11,  The  NADGE  Simulation  System  will  primarily  produce  e  simulated  throat  and  operational  anvironmant 
for  the  system  operators.  In  the  design  of  the  on-line  (reel-time)  simulation  software  every  effort  wee 
made  to  permit  the  system  to  operate  in  a  simulated  environment  in  tha  same  way  aa  it; does  in  tha  real 
air  defence  anvironmant,  For  this  purpose  tha  reel  operational  data  base  of  the  system  is  used  in  simu¬ 
lated  ope.:- tion*.  In  addition  tha  processing  of  simulated  radar  plots  by  the  correlation  end  tracking 
software  is  -  as  mentioned  before  -  the  earns  as  for  real  plots,  This  faaturt  -  outside  war  gaming  - 
would  allow,  for  example,  the  evaluation  and  optimisation  of  different  tracking  logics  using  defined 
Simula tad  radar  inputs, 

12,  Tha  overall  NADGE  simulation  aoftwara  package  utilises  I  1 

-  a  dynamic  modal  of  tha  currant  intelligence  air  thrust  scenario  which  includes  existing  aircraft  kinds 
and  numbera,  their  tactics,  profiles,  sortie  rates,  targeting,  end  performance  characteristics  aa  well 
as  the  application  of  electronic  warfare  (ECM)  technique!  (electronic  jamming  end  chaff),  end  some 
weather  date  (winds  aloft)  ; 

-  dynamic,  modal  a  of  tha  performance  and  tactics  of  several  NATO  air  dafance  interceptor  aircraft  ! 

-  static  models  of  tha  performance  of  »ome  NATO  aurface-to-air  missile  (SAM)  systems  | 

-  Comprehensive  static  models  of  the  technical  characteristics  end  detection  capebllitiae  of  all  NADGE 
air  dafance  ground  radars  Including  noma  form  of  simulating  the  affect  of  jamming, 

11.  Tha  general  concept  in  generating  a  simulated  air  picture  (Fig.  6)  ia  to  have  a  library  on  magnetic 
tape  ofall  kinds  of  friendly  and  hostile  flight  path  models  which  are  derived  from  the  latest  intelligence 
information.  This  "target  library"  may  be  updated  continuously  and  contains  several  thoueend  individual 
flight  paths  covering  the  who?**  eras  of  NATO  Europe.  Depending  upon  the  purpose  and  objectives  of  the 
war;  game,  the  user  selects  out  of  this  library  the  flight  path  models  required.  With  thie  information 
and  the  desired  activation  timte  of  the  selected  flights,  a  "master  flight  path  tape"  ie  generated  con¬ 
taining  the  overall  air  situation  of  a  war  game  as  it  develops  over  time.  During  thie  process  the 
appropriate  aoftwara  calculates  for  all  radareitae  participating  in  the  war  game  where  and  whan  each 
individual  simulated  flight  path  ie  within  theoretical  radar  coverage  of  a  alts.  Track  loads  exceeding 
the  computer  track  store  capacity  of  the  participating  sitae  ere  thua  avoided.  From  the  "maBter  tape" 
tha  individual  air  situation  of  each  site  la  split  off  using  a  modal  of  tha  real  radar  coverage. 

These  magnetic  tapes  (called  "raid  tepee")  then  form  tint  simulated  radar  input  for  war  gaming. 

PHASES  OF  AIR  DEFENCE  WAR  GAMES 

14.  Tha  war  games  or  axarciaes  "played"  within  tha  air  dafance  ground  environment  include,  an  mentioned 
before,  the  human  player  and  depend,  therefore,  on  human  judgement  and  decisions.  In  addition  it  must  be 
empties iaad  that  these  games  serve  more  the  purpose  of  training  and  operational  analysis  thsn  of  scisnti- 
fic  rssearch.  This  means  that  tha  large  number  of  political,  economic,  and  logistic  factors  which  influ¬ 
ence  military  operations  play  more  the  role  of  background  information  than  of  active  inputs  into  ths 
gams.  In  principle  there  are  four  phases  involved  in  the  game  activity  which  are  design,  production, 
play  and  analysis  (Fig,  7  and  Kg.  8), 

13.  Tha  design  phase  start*  with  the  definition  of  the  purpose  or  objective  of  the  game  which  dictates  l 

-  the  selection  the  geographical  location,  duration  of  the  game,  and  the.  weather  ; 

-  the  compoaition,  location  and  atata  of  readiness  of  tho  defender’s  and  attacker's  forces  t 
••  tha  development  of  the  air  threat  and  targets  to  be  attached  ; 

-  sequence  and  timing  of  tactical  event  inputs  (i.e.  development  of  the  alert  statua,  tactical  action 
results)  i 

-  the  definition  of  a  fictional  political,  economic  and  logistical  scenario  that  led  to  the  confrontation 
and  its  further  development  aver  time. 

Hiving  developed  these  simulated  inputs  tha  rulaa  of  the  game,  tailored  to  the  particular  game  situation, 
will  be  elaborated,  These  rules  Include  any  restriction*,  attrition  factors  and  all  klnda  of  "planning 
factors".  In  general  term*  tha  dasign  reflects  alt  event*  and  fsetora  requited  to  satisfy  aubssqusnt 
analysis  and  evaluation  purpoaaa  )  it  must,  however,  at  woll  ensure  a  chaUeiiBlng  play  phase.  In  tha  Air 
Dafance  Ground  Environment  moet  war  games  sre  designed  to  teet  the  efficiency  of  the  syetem  and  its  ope¬ 
rators  against  the  predefined  threat  tcanario  which  ropreasr.t*  a  model  of  tho  real  threat  expected. 

Tho  simulated  threat  inputs,  therefore,  ehould  be  tailored  by  the  designing  tesm  to  trigger  answers  to 
those  analytic  questions  upon  which  oparationsl  analysts  or  evaluation  teams  will  base  thair  flndingi 
after  the  game,  Theeu  quaitiond  ere  normally,  for  example,  along  the  following  lines  : 

-  How  early  did  the  system  pick-up  targets  ? 

-  How  many  and  what  kind  of  targets  remained  undetected  or  wan*  lost  1 

-  Wat  track  identification  (i.e.  FRIEND  or  FOE)  correct  and  in  time  ? 

-  Dit  the  system  allocate  targets  to  defensive  reaponl  and  achieve  "kills"  before  the  defended  areas  have 
bean  entered  7 


The  answers  Co  this  kind  of  questions  then  lead  to  findings  about  the  efficiency  or  deficiency  of  ! 

-  System  operations  personnel  from  the  Command  level  down  to  the  console  operators, 

-  Operational  procedures,  and 

-  The  syatam'a  hardware  and  aoftwara  functions  involved. 

16,  In  the  production  phase  the  design  specifications  are  transferred  into  formats  aocspttbls  by  a 
apecial  simulation  preparation  software.  These  computer  programs  hava  besn  developed  by  the  MATO 
Programming  Centra  (NPC)  and  era  in  field  uae  to  generate  the  simulated  sir  situation  on  magnatic 
taps  and  utilising  the  threat  and  radar  models  explained  before, 

17.  Typical,  for  the  play  phaae  of  a  tvo-eidad  air  defence  game  (ur  exercieo)  ia,  that  the  attackar'a 
course  of  action  ia  preset  by  simulated  inputs  from  magnetic  tape,  but  that  the  friendly  team  ia 
allowed  to  play  frae  in  aocordanxe  with  the  development  of  the  aimulated  threat  and  the  defender1! 
estimate  of  the  aituatlon,  The  game  ia  started  by  an  intelligence  briefing  for  all  participant* 
which  describes  ehs  general  and  spaolal  situation  and  svsnts  that  initiate  tha  conflict.  All  moves 
made  in  the  game  ara  monitored  by  a  Directing  Staff  which  clarifies  any  confusions,  ertforcss  the 
rules,  evsluatss  and  asiaaaei  tha  result  of  each  move,  initiates  subsequent  event  Inputs  and  injecta 
tactical  action  events  as  dictatad  by  tha  design.  All  actions  taken  by  the  players  (defender)  as  well 
as  tha  development  of  the  air  situation  ar*  recorded  on  magnetic  tape, 

IB,  Tha  analysia  phase  of  war  games  performed  within  the  NADGE  system  is  supported  by  a  computer 
program  package  developed  aa  well  by  the  NPC .  This  software  has  been  designed  to  handle  the  great 
volumes  of  recorded  operational  data  and  to  anabla  evaluation  taama  and  system  analysts  to  i 

-  analyse  and  evaluate  operator  actions  and  system  functions  ;  ' 

-  test  the  performance  of  the  NADC3E  operational  (real  time)  aoftware  ( 

■  compile  a  data  baas  which  allows  derivation  of  evaluation  criteria, 

Tha  output  of  these  analyaia  programa  ia  straight  facts  in  s  convenient  and  easy  to  read  format,  while 
evaluation  programs  in  addition  compare  these  result*  to  defined  standards  and,  if  desired,  to  past 
performances. 

THE  ANALYSIS  AND  EVALUATION  PROCESS 

19.  Tha  operational  data  recorded  within  the  NADGE  aystam  on  magnetic  tape  may  be  processed  after  the 
garni  by  tha  NADGE  analysia  software  Which  provide  for  flexibly  selecting  and  organising  this  dsta  in 
tha  forms  moat  sfficicnt  for  ths  ussr,  Ons  foot  to  be  observed  is  that  ths  information  needs  of  tha 
variou*  users  are  markedly  different  and  call  for  providing  varying  levels  of  detail.  The  major 
functions  of  the  overall  analysis  and  evaluation  process  are  t 

-  to  pressnt  objectively  ell  significant  sir  track  related  events,  operator  actions  and  system  functions  | 

-  to  produce  figures  of  how  much  has  been  achieved  compared  with  the  expected  aa  presented  by  defined 
Simula tad  data  Input  or  appropriate  evaluation  criteria. 

20.  During  the  design  phase  of  the  evaluation  aoftware  those  data  elements  contributing  to  system 

and  operator  performnneo  had  to  be  identified  from  the  huge  recorded  data  base,  Although  skilled  .system 
analysts  and  programmers  with  knowledge  of  the  real-time  operational  NADGE  programa  and  its  associated 
recording  system  can  perform  functional  analysis  of  system  activities  and  information  flow,  they  can 
at  beat  formulate  candidate  analysis  and  evaluation  mssaures  and  output  formats.  It  was  left,  therefore, 
to  thoee  personnel  with  direct  experience  in  system  operations  to  provide  ultimate  judgements  as  to 
design  requirements,  identifying  data  needed,  and  finding  evaluation  standards.  The  problem  of  determi¬ 
ning  whether  the  mission  performance  of  an  individual  unit  or  a  ayatem  was  "good"  or  "bad"  ia  compounded 
by  s 

-  the  complexity  of  the  interrelationship  In  factors  of  the  air  defence  system'n  environment  j 

-  the  complexity  of  the  NADGE  system  design  i 

-  the  definition  of  evaluation  criteria  and  standards, 

It  is  felt,  therefore,  that  perfection  in  evaluating  air  defence  systems  and  units  by  comparing  recorded 
events  to  absolute  and  stringent  standards  which  satisfy  all  aspects  can  hardly  ho  achieved,  The  approach 
taken  to  find  a  fair  solution  was  to  present  "facts"  und  leave  it  up  to  the  user  to  define  atandards  for 
comparison  with  tha  results  (facts)  achieved,  and  to  "weight"  the  inter-play  of  complex  factors  and 
variables  in  an  operational,  environment. 

21.  Furthermore,  it  should  be  noted,  that  the  interrelationship  between  tho  variables  of  the  operational 
environment  and  mission  performance  con  neither  ho  fully  predicted  nor  strictly  controlled  by  s  play 
scenario  and  a  directing  staff.  In  other  words!  oven  with  a  standard  gome  design  there  will  be  no  war 
game  exactly  like  another.  The  impact  of  these  factora  cannot  be  measured  by  the  machine  and  the  user 
must  take  care  of  proper  weighting.  The  figures  produced  automatically  nan,  therefore,  form  only  part  of 
the  overall  analysis  und  evaluation  process.  It  remains  up  to  tho  commAnd/aoalysls  personnel  involved  to 
interpret  the  remits  ami  draw  the  correct  conclusions  from  them  and  initiate  feed  hack  into  tho  opera¬ 
tional  environment  na  well  as  the  purpose  and  objectives  of  subsequent  war  games  (Fig,  B)  . 
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22.  As  mentioned  before  the  operational  data  recorded  during  the  "play  phase"  contain!  a  compilation 
of  straight  facts  gathered  during  eevatal  hours  of  "play  time"  for  hundreds  of  different  air  tracks. 
The  analysis  programs  developed  in  principle  compare  end  correlate  the  recorded  event!  on  a  track  by 
track  basis  with  tha  prescripted  simulated  data  which  was  real  time  input  into  the  system  during  the 
"play  phase"  of  the  war  game.  Tha  expected  situation  and  what  the  system  produced  after  processing 
this  input  is  thus  represented  (Fig.  9).  The  result  of  this  comparison  produces  objective  figures 
of  whet  has  been  achieved  during  the  "play  phase",  end  which  may  ba  arranged  in  the  form  of  easy  to 
evaluate  diagrams.  Tha  answers  to  the  analytic  questions  defined  in  the  "design  phase"  may  thua  ba 
anawerad.  Soma  axampls  diagrams  using  fictitious  data  ara  shown  in  Figures  10  to  13. 

C0NCMJSI0KS 


23.  War  gaming  within  controllad  environmental  conditions  and  bared  on  carefully  designed  simulated 
inputs  is  considered  a  powerful  and  challenging  vehicle  by  which  to  train  and  analyse  an  automated 
sir  defence  system  or  parts  of  it.  The  system  described,  which  ia  in  field  use  throughout  tha  NADOE 
system,  can  highlight  problem  areas  in  aits  operation*  end  system  functioni.  Depending  on  tha  type  of 
problem  encountarad,  ona  can  investigate  possible  caui.cs  or  design  further  special  war  gamae  to  discover 
vhather  the  problems  encountered  are  repeated  or  to  collect  more  data.  In  any  cast  the  strength  and 
weaknesses  of  site  operations  or  system  functions  must  be  taken  into  account  in  the  design  of  future 
wsr  games  or  analysis  schemes.  The  smell  expenditure  of  manpower  that  ia  required  to  obtain  result* 
from  the  analysi*  outputs  in  a  form  of  immediate  use  to  evaluation  personnel  and  system  analysts  tesms 
to  be  a  small  price  to  pay  and  ii'  irrelevant  whan  compared  to  the  cost  and  planning  time  required  for 
live  flying  activities. 
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Fig. 7  Phases  of  air  defence  war-games 


I'ig.8  War-guming  overall  Interrelationship 
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Fig. 9  Analysis  process  in  principle 
(Example  related  to  an  individual  (light  path) 
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Although  raal-tima  aimulation  can  gat  hr  r  aartain  types  of  evidence  which  oan  he  obtained  in  no  other  way, 
it  oannot  validly  be  applied  to  numerous  problems  in  large  man-maohine  syetema.  Real-time  eimuXation 
can  be  viewed  as  one  of  several  techniques  in  a  hierarohyi  the  simplest  teohniquas  use  paper  and  penoil 
methods  and  the  most  elaborate  require  real-life  operational  systems.  The  exiatsnoe  of  large  and 
expensive  retil-timc  simulation  facilities  has  helped  to  promote  their  overuse.  The  paper  appraises 
real-time  simulation  as  a  technique,  with  particular  emphasis  on  its  limitations. 

1 .  HISTORICAL  BACKGROUND 

Real-time  simulation  has  beoom.t  Indispensable  in  the  development  of  oomplex  operational  systems.  This 
paper  diaoussos  real-time  simulation  as  a  technique,  drawing  examples  mainly  from  air  traffic  oontrol 
and  air  del'onoe  systems  in  the  United  Kingdom. 
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Real-time  simulation  in  its  present  form  originated  in  simulations  of  aspeots  of  air  defenoa  systems 
during  ths  Ssoond  World  War  (Maokvorth,  1 950 J.  In  thise  studies,  many  taohniques  which  art  still  ourrent 
were  first  developed,  and  attempts  were  made  to  explain  the  findings  from  real-time  simulations  in  terms 
of  psychological  theories  of  the  day,  in  order  to  establish  their  generality  arid  permit  their  extrapola¬ 
tion. 

These  early  attempta  at  real-time  simulation  marks!  a  change  ir  research  philosophy.  Before  them, 
measures  of  man-maohine  systems,  using  tsohniquss  tuoh  as  time  and  motion  atudy,  sought  to  inoreaat  out¬ 
put  rather  than  to  assess  ths  effaots  of  ths  system  on  the  man,  but  in  thacs  aarly  attempts,  man  began  to 
be  treated  as  an  s lament  or  oomponent  of  the  system.  It  became  apparent  that  the  effectiveness  of  any 
oomplex  system  depended  on  oharaoteriitioe  of  its  operators  as  well  aa  on  charaoterietloa  of  the  ayetem 
itself.  The  pioneering  work  of  Craik  (1945)  -uid  of  Hick  (1947)  on  the  performance  oharaoteristioe  of  the 
operator  began  the  taek  of  expressing  human  characteristics  in  mathematical  or  engineering  terms  com¬ 
patible  with  those  used  to  specify  other  system  components  and  their  funotiona.  This  approaoh  enoouraged 
ths  use  of  real-time  simulation  whioh  had  the  advantage  of  being  able  to  integrate  run  and  maohine  and 
measure  them  together  under  rigorously  controlled  experimental  conditions. 

Thaso  first  attempts  to  interpret  the  findings  from  real-time  simulations  of  air  defenoa  or  air  traffic 
oontrol  systems  in  terms  of  pay  oho  logical  theory  were  nevor  totally  euooeeeful.  evan  though  the  rationale 
for  trying  to  do  so  remained  attraotive.  Several  explanations  oan  ba  offered  in  retioepeoti 

1.  the  theorise  ware  wrong; 

2.  the  oonoephr  had  limited  applicability; 

3.  real-time  simulation  was  not  on  appropriate  technique; 

4.  there  was  too  large  a  discrepancy  between  thr,  roal-time  simulation  and  the  laboratory 
axperimente  from  wh.ioh  the  theories  originated. 

The  pauoity  of  alternative  tsohniquss  and  the  apparent  suooeus  of  real  -time  simulation  perhaps  made 
inevitable  the  unor'tlool  over-extension  of  real-time  simulation  as  a  technique. 

As  real-time  simulation  became  entrenched,  specially  devised  simulation  uomploxee  for  air  defenoa  or  air 
traffic  control  rjystems  were  built.  Many  of  these  have  been  described  by  Paraon’o  (1972).  Their  oon- 
etruotion  and  maintenance  wore  expensive,  and  ea-.h  represented  a  major  commitment  of  resources  whioh  had 
to  bo  justified  by  high  utilisation.  This  had  two  oonsequenoeo .  Firstly,  the  simulation  facility, 
beo^uBe  it  was  available,  was  sometimao  used  to  study  questions  although  ths  applicability  of  real-time 
simulation  as  a  teohnique  oeemsrt  dubious.  Secondly,  ilia  questions  to  be  studied  were  modified  until  they 
fitted  the  real-time  simulation  facility. 

2.  THE)  HYBRSm  OF  REAL-TIME  SIMULATION 

The  range  of  themes  which  real-time  simulation  studies  of  air  traffic  oontrol  eysteme  in  the  United 
Kingdom  have  considered  is  illustrated  in  the  fallowing  list  of  headings  and  examples.  An  examination  of 
real-time  simulation  studies  of  aspects  of  nir  defenoe  systems  would  produo*  a  comparable  list.  It  seems 
unlikely  that  thu  teohuiqus  of  real-time  simulation  oould  be  »o  robust  that  it  is  equally  suited  to  all 
thee#  themes, 

1.  Major  He-etruot urlr.g  of  an  Air  Traffic  Oontrol  Region.  This  involves  r« -casting  the 
air  traffic  oontrol  methode,  facilities  and  procedures  within  a  region.  An  example  is 
the  comparative  evaluation  of  thu  four  possible  sites  proposod  a  few  years  ago  for  a 
third  London  Airport  (Ward-Hunt  et,  al.,  197°). 

2,  Uevioad  Divisions  of  Airspace.  Simulation  studies  may  seek  to  explore  all  the  effeots 
of  proposed  chargee,  or  be  oonoemed  only  with  their  oensequsnoes  for  a  designated 
legion  or  seotor.  Examples  are  the  specification  of  ths  optimum  geographical  region  to 
be  oovored  from  a  oontrol  centre  in  relation  to  the  needs  of  adjacent  sectors 

(Cloorgo  ot  al.,  1971),  and  the  effects  of  ohanges  in  seotor  boundaries  on  the  oontrol  of 


traffic  within  a  aaotor  (Crompton  A  Hopkin,  197?)* 

3.  Co-ordination  and  Liaison.  Thai*  factor*  oun  b*  great ly  affeoted  by  propoeed  changes, 
and  may  ultimately  determine  their  praotloabllity.  One  simulation  study  waa  oonosmed 
with  a  requirement  to  interweave  crossing  traffic  through  tha  flow  of  eiroreft  along  an 
airway  (Thayer  et  al.,  1973). 

4.  Th*  Allocation  cf  Tasks  and  Responsibilities.  These  topios  are  linked  to  manning  levels, 
ths  grouping  of  tasks  and  the  possible  amalgamation  of  fixietione.  Cne  example  compared 
alternative  air  traffic  oontrol  procedures  end  divisions  of  responsibility  to  facilitate 
the  training  of  military  student  pilots  (Thayer  et  al.,  1972).  A  aaoond  example  con¬ 
sidered  the  height  level  at  whioh  air  trafflo  oontrol  responsibilities  should  pass  from 
one  controller  to  another  (George  et  al.,  1972). 

5.  The  Provision  of  computer  Assletenoe.  An  eid  Intended  for  general  application  may  have 
suoh  wide  end  diverts  implications  that  they  have  to  be  studied  by  a  eerier  of  related 
simulations.  An  axeaple  oonoeme  the  benefits  of  redar  data  processing.  In  studying 
this,  basio  data  were  qollaeted  first  (Crompton  et  al.,  1974)>  and  than  civil  (Webber 
et  al.,  1976)*  end  military  (ohurohill  et  al.,  1977)  applications  were  examined 
separately. 

6.  The  Improvement  of  Trafflo  Handling  Oapaolty  or  Safety ..  The  Main  purpose  of  an  aid  may 
be  speolfiol  if  so,  it  must  bs  svaluated  aooordingly.  Ons  study  evaluated  an  auto-alert 
faoillty  to  indicate  whenever  an  a^roraft  le  straying  from  its  planned  flight  path 
(George  et  al.,  1973).  Two  atudlee  of  oomputer^seieted  approach  sequencing  of  airorafc 
on  final  approaoh  to  a  single  runway  (Feorn  A  Hopkin,  197?)  or  to  parallel  runways 
(Bowsstt  et  al.,  1977)  oonstitut*  a  further  oxtmpls. 

7.  Feasibility  Studies.  In  thsse,  the  simulation  exercises  do  not  follow  a  fixed  experi¬ 
ments!  protocol,  but  svolve  in  order  t '  explore  probleme  te  they  are  identified.  The  air 
trafflo  oontrol  probleme  of  a  group  of  adjacent  oontrol  aaotora  have  bean  examined  in 
this  way  (Feam  et  al.,  1973). 

8.  The  Evaluation  of  Technological  Innovations.  Often  these  were  not  devised  originally  for 
air  trarfio  oontrol,  but  an  application  of  them  to  sir  trafflo  oontrol  it  sought,  An 
example  is  tha  ue«  of  light  emitting  diode*  in  a  distsnoe  from  touchdown  indioator  (Cook* 
et  *1.,  1977).  A  further  example,  the  subject  of  numerous  simulations,  oonusmt  th* 
oodlng  of  air  trafflo  oontrol  computer  generated  information  in  oolour  (Hopkin,  1 S77)* 

3.  REAL-TIME  SIMULATION  IN  RELATION  TO  OTHER  TECHNIQUES 

Raal-time  simulation  belongs  to  a  hierarohy  of  technique*  for  the  study  of  man-maohine  systems.  They  oan 
range  from  studies  with  vary  eimpl*  apparatus  to  measures  of  real-llfs  systsms. 

Studies  with  simple  apparatus,  or  even  with  paper  and  penoil,  ere  intended  to  explore  and  define  general 
or  epeolfio  human  abilities  and  limitation*.  They  permit  th*  examination  of  a  few  variables  at  a  time, 
so  that  their  effeote  on  performance  and  th*  interactions  between  them  oan  be  established.  Suoh  studies 
may  auggeat  whether  abilities  could  be  Improved  or  limitations  overoom*.  They  oan  provide  evideno*  on 
tasks  that  are  suitable  for  study  by  real-time  simulation,  on  appropriate  lsvals  of  difficulty,  end  on 
meeeurable  aspects  of  psrformsnos. 

Tha  next  logical  otsp  is  to  oonduot  more  extensive  investigation*  to  establish  whether  th*  finding*  oan 
validly  ba  axtrapolated  from  atatio  to  dynamic  conditions.  Controlled  dynamic  laboratory  experiment*  oan 
help  to  define  the  most  orltioal  events  end  olroumstenoee  end  indicate  the  probebla  capability  of  th*  man 
to  do  th*  tasks  envisaged  in  the  real-time  simulation.  Without  nioh  experiment  a,  the  validity  of  th* 
findings  of  real-time  simulation  may  be  disputed. 

An  the  complexity  of  dynamic  experiments  inoraeses,  they  normally  incorporate  mO'.e  of  th*  features  of 
real-time  simulation,  such  as  representative  tasks,  realistic  workepaoes,  end  pliyeioal  environment  el 
oondltlonD.  There  is  no  dear  dividing  line  between  s  complex  dynemio  experiment  end  ft,  eimpl*  raal-time 
simulation.  Criteria  for  differentiating  between  them  include  etiiat  adherence  to  an  experimental  design 
with  full  oontrol  over 'the  variables,  and  tha  extent  to  whioh  all  relevant  features  of  the  real-life  task 
have  been  rep  11  oat  ail. 

Real-time  simulation,  th*  mein  them*  of  this  paper,  should  be  preceded  by  static  and  dynamic  experimental 
studlaa.  It  should  be  followed  by  verification  of  it*  finding*  in  real-life.  Comprehensive  and  systema¬ 
tic  measures  tr*  diffioult  to  obtain  in  real-life.  Real-life  data  are  seldom  as  otruotured  and 
oomprehsneiv*  as  data  from  realtime  aimulatl  .ma,  A  fundamental  weakness  of  real-time  simulation  ia  that 
ultimately  the  credibility  of  <t*  findings  depends  on  real-life  verification  which  ia  rarely  attempted 
and  may  be  impraotioal. 

4.  REAL-TIME  SIMULATE CM  A3  AN  INVESTIGATIVE  TECHNIQUE 

4.1.  Hatoi led  Planning 

To  be  effeotive,  real-time  simulation  muut  not  only  be  used  c  ,'rreotly  in  relstion  to  other  teohnique* 
out  must  also  he  introduced  at  an  appropriate  stag*  in  the  system  development  (Keister  A  Rabideau,  1965). 
One  major  benefit  of  real-time  simulation,  an  inoidantal  product  of  it  which  teems  to  bs  consistently 
-jndsrestimated,  is  that  in  order  to  plan  end  oonduot  the  simulation  it  ia  esssntial  to  specify  thoroughly 
and  in  detail  exactly  how  the  ayutem  will  function.  Without  real-time  simulation,  this  may  never  be  done. 
The  construction  of  semplua  for  real-time  aimulstion  entails  clarification  of  th*  probleme  to  be  studied, 
or/,  of  th*  methods  and  measures  to  be  employed.  Th*  functioning  of  the  system  hae  to  be  envisaged  in 


detail  before  th*  hardware  and  aoftware  for  real-time  •lnulation  oan  be  apeoified.  Aa  a  result,  before 
the  real-tine  simulation  begins,  many  of  the  questions  originally  posed  Hill  have  been  partly  answered. 
The  oonduct  of  the  real-time  simulation  often  puts  quantitative  values  on  these  more  intuitive  answers. 
The  fact  that  the  prooens  of  real-time  simulation  demands  this  preliminary  thinking  is  a  major 
advantage . 


4.2.  System  Inputs  and  Outputs 

Real-tin*  simulation  is  generally  system  orientated.  Input  variables  typioally  oontrolled  are  the  numbers 
of  airoraft  or  targets.  Measures  attempt  to  relate  variations  in  these  input  nuabers  to  measured  outputs 
from  the  system.  In  order  to  gain  an  understanding  of  how  the  aystem  function!,  it  la  ntoeasary  to 
oontrol  inputs,  define  outputs  sad  explore  their  lntsraotione  carefully.  A  reourring  finding  from  real¬ 
time  simulations  is  that  attributea  of  tha  operator,  as  distinot  from  aspects  of  the  system,  greatly 
affect  aystem  outputs  through  operator  processing  (Older  &  Cameron,  1972).  In  any  event,  real-time 
simulation  must  taka  acoowvt  of  attributes  of  the  operator  as  wall  aa  those  of  the  system.  Although 
questions  oan  be  posed  in  terms  of  targets  that  an  air  dafsnoa  ayatem  oan  handle  in  a  given  time  or  tha 
maximum  rata  of  airoraft  movement*  per  hour  that  an  air  traffio  oontrol  ayatsm  oan  deal  with,  it  doee 
not  follow  that  rsal-tims  eimulation  oan  provide  a  valid  answer  to  euoh  questions  or  even  that  a  aanaibla 
answer  to  suoh  questions  exists.  A  potential  advantage  of  real-time  simulation  aa  a  teohniqus  is  that  it 
doss  not  have  to  be  exclusively  system  orientated,  though  it  usually  is.  The  performance  of  spoolfio 
tasks  oan  be  measured  not  only  in  relation  to  system  variables,  but  also  in  relation  to  the  demands  whloh 
they  impose  on  the  operator  and  to  individual  dlffarsnoes  between  operators. 

In  a  typioal  real-tins  simulation,  the  inputs  to  ths  system  are  speoified  exaotly,  tha  oonasquanoss  of 
apaoifled  ohangss  in  them  are  quantified,  and  ths  simulation  design  is  derived  from  the  findings  of 
preliminary  laboratory  experiments.  This  approach  in  sensible,  and  indeed  is  ths  bsat  one  for  many  pur¬ 
poses  of  real-tints  simulation.  But  it  is  not  ths  only  one,  because  real-time  simulations  oan  bs 
exploratory.  A  useful  role  for  real-time  simulation  is  to  try  out  new  ideas,  with  suffioient  realism  to 
establish  whether  they  are  worth  serious  consideration  and  furthar  dsvelopmant. 

4.3.  Comparativa  Aassaamanti 

Onoa  it  haa  bean  aatabliahad  that  a  naw  idea  ia  faaaible,  than  real-time  simulation  oan  ba  used  to  make 
oomparisona.  Often  the  essential  evidence  is  not  that  a  new  idea  1s  praotioal  but  that  it  is  bettar  than 
what  it  would  replaoe  (Orr  4  Hopkin,  1972).  There  are  difficulties  in  making  this  kind  of  comparison. 

Whan  real-time  eimulation  ia  used  to  compare  a  new  and  axi sting  idaa,  the  expected  advantages  of  tha  naw 
Idas  are  already,  to  soma  extent,  known,  and  tha  real-time  simulation  is  designed  to  demonstrate  thasa 
axpaotsd  advantages.  Ths  disadvantages  of  ths  new  idea  hava  naver  been  considered  with  equivalent 
thoroughness,  end  therefore  simulation  may  fail  to  revoal  them. 

Aa  a  general  principle  any  change,  particularly  in  a  system  context,  brings  both  advantages  and  disad¬ 
vantages.  Both  should  reoeiva  equal  attention  in  a  comparative  simulation  (Hopkin,  1 970).  A  mujor 
benefit  of  real-time  simulation  as  a  teohniqus  is  that  it  allows  in  principle  the  impartial  investigation 
of  advantages  and  disadvantages. 

A  further  eouroe  of  bias  oan  arias  when  real-time  simulation  is  used  to  oompara  automated  end  manual 
mathoda  of  performing  f motions.  There  may  bs  the  implioit  assumption  that  the  automated  method  must  bs 
better.  As  a  result,  if  ths  automated  method  proves  inferior  to  ths  manual  one,  muoh  effort  is  expended 
on  improving  it  uitil  it  is  as  good  as  or  better  than  tha  manual  one,  whereao  if  the  automated  method 
la  already  superior  to  tha  manual  one,  oomparable  effort  is  not  sxpsndsd  on  improving  the  manual  method 
until  it  is  as  good  as  or  better  than  the  automated  one.  An  optimised  maohine  is  oompared  with  a  non- 
optimiasd  man. 

Normally  any  change  affeote  ths  kinds  of  error  whioh  oan  oocur.  A  main  reason  for  roplaoing  equipment 
may  be  the  removal  of  unaooaptabla  errors  associated  with  it.  However,  whatever  ie  introduced  in  its 
stead  will  hava  its  own  oharaoteristio  errors.  For  exssple,  the  replacement  of  spoken  messages  by 
transponded  data  whioh  appear  on  display*  replaces  phonatio  confusions  with  visual  misreadings.  Real¬ 
time  simulation  must  therefor*  seek  to  establish  which  errors  actually  ooour.  Furthar  current  examples 
oonoem  th*  errors  introduced  by  odour  ooding  of  displayed  information  (Hopkin,  1977),  and  th*  error* 
whioh  automated  speech  eyntheei*  and  epetch  recognition  mey  generate  (Connolly,  1976). 

4.4.  Oholoe  of  Subjects 

The  oholoe  of  subjects  oan  have  a  oruoial  influano*  on  th*  findings  of  real-time  simulation,  dis  com¬ 
petent  operator  participating  in  a  simulation  may  bs  suffioisnt  to  show  that  in  idea  is  feasible. 

Usually  the  aims  of  real-time  simulation  ore  more  ambitious  and  inoludo  ths  assessment  of  individual 
differences  between  operators  by  representative  sampling.  The  extent  to  whioh  those  chosen  to  parti¬ 
cipate  are  truly  representative  influano**  th*  findings. 

One  solution  is  to  employ  aubjeota  whose  main  job  is  to  participate  in  simulations.  Their  performance 
and  opinions  msy  bs  helpful  and  full  of  insights  for  eimulation  purpoeos,  but  biased  btoause  of  their 
familiarity  with  simulation.  An  alt  amative  solution  is  to  employ  as  participant*  in  ths  simulation 
those  who  fulfil  an  equivalent  role  in  oxioting  systems.  Using  their  specialist  knowledge,  they  can 
point  to  th#  aspeot*  of  real-life  whioh  have  been  inadequately  replioated  in  th#  simulation  and  which 
may  therefore  render  th#  finding#  invalid.  Their  familiarity  with  ths  equivalent  fuiotions  in  real-life 
may  bias  their  performance  and  opinions.  Further  difficulties  arise  in  ohooeing  lubjeots  for  compara¬ 
tive  simulation  studies,  where  the  new  and  familiar  are  oompared.  Experienced  eubjeots  are  already 
practised  on  the  familiar  equipment  far  more  then  they  oan  be  on  the  new,  whioh  introduces  a  bias. 

Naive  eubjeots,  for  whom  the  items  being  oompared  are  both  new,  may  never  become  fully  profioient  within 
th*  praotioal  time  limits  of  real-time  eimulation.  Furthermore,  the  training  method*  are  known  for  th* 
familiar  equipment  but  have  to  be  devised  for  the  new. 
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5.  REAL-TIME  SIKULaTXCN  AMD  CURRENT  HUMAN  FACTORS  PRCBLKMO 

5.1.  Th*  Introduction  of  Computer  Assistance 

A  conaon  application  of  real-time  eimulation  ia  to  examine  varloue  forma  of  oomputer  aaaiitanoe.  Aa 
automation  progress**,  the  liat  of  ftnotions  which  can  he  oonaidered  in  term*  of  whether  they  ahould  he 
performed  hy  man  or  by  maehlno  inoreaaea.  Thia  i*  a  matter  of  teehnioal  progress  and  not  of  human 
faotora  (Benoit,  1776;.  A  oonssqusnos  ia  that  the  man  may  he  left  with  the  taalca  which  have  proved 
diffioult  to  automate  rather  than  those  for  whioh  he  ia  particularly  auited,  For  example,  he  tenda  to  he 
oaat  in  monitoring  rolea  where  he  ia  inefficient,  or  in  supervisory  roles  whioh  he  has  difficulty  ia 
fulfilling  in  highly  automated  systems.  Real-time  simulation  oan  establish  whether  the  man  will  actually 
ha  able  to  fulfil  the  role*  assigned  to  him  (Hopkin,  1976).  It  can  also  ha  used  tc  examine  the  praotloal 
skills  whioh  he  will  need  (Whitfield  A  Stammer*,  1973). 

5.2.  The  Measurement  of  System  Capacity 

Real-time  simulation  in  often  used  to  try  and  aasssa  system  oapaolty  (Par* one,  1972).  The  oapaoity  of 
the  system  relates  to  the  system  as  a  whole,  hut  the  findings  of  a  real-tin*  simulation  are  influenced 
hy  the  behaviour  of  the  individual  operators  participating  in  it.  Therefore  thie  teohniqus  oannot 
provide  answers  to  questions  of  aystsm  oapaoity  whioh  are  divoraed  from  ohareoterietios  of  the  operators. 
Real-time  eimulation  oan  never  reproduoe  faithfully  every  aspect  of  real-life i  for  inetenos,  the 
emotional  climate  under  whioh  the  work  is  done  and  the  etate  of  learning  and  proficiency  are  different. 
The  effeots  of  euoh  operator  oharaotarlatioa  on  aystsm  oapaoity  are  uncertain.  In  simulation  it  is 
necessary  to  retain  some  control  over  the  permitted  eouroei  of  varlanoe  in  order  to  gather  meaningful 
quantitative  data.  To  the  operator,  thia  oonitraint  often  engender*  an  artificial  smoothneae  and  pre¬ 
dictability  in  the  simulation  txeroiaaa,  with  indeterminate  oonsequenoee  for  system  oapaoity  measures. 

5.3.  Workload 

Thar*  is  a  great  demand  in  air  dafenoe,  air  traffio  control  and  other  systems  to  asB*st  operator  workload, 
hut  it  is  diffioult  to  do  so  validly  using  real-tins  simulation.  Confusion  often  arises  if  workload  is 
equated  with  the  demands  which  the  taaka  impose  upon  the  operator,  sine*  workload  depends  also  on  hit 
individual  oharaotsriitioa.  Workload  i*  a  multifaoeted  oonoept,  affsotad  hy  an  operator's  knowledge, 
experience,  profioienay,  attitudes,  training,  aptitudes,  understanding,  age,  etc  (Moray,  1979).  Various 
attempts  to  msaaur*  workload  using  real-time  simulation  havt  btsn  made  in  air  traffio  oontrol 
(Srgonomioa,  1971).  Hies*  generally  treated  workload  as  a  single  measurable  dimension,  uhioh  it  la  not 
(Moray,  1979).  Assessmsnts  whioh  alaim  to  nwaaure  workload  along  a  single  dimenelon  should  therefore 
be  treated  with  eoeptioiem.  The  appraisal  of  workload,  insofar  aa  it  ia  possible,  almost  oertainly 
requires  numerous  kinds  of  measure .  Real-time  simulation  oan  however  be  used  to  establish  task  demands, 
and  aaaeaamanta  may  ba  mad*  of  whether  thee*  demands  are  exosaslve  for  particular  operator*.  Task 
demands  ahould  not  be  equated  with  workload. 

5.4.  Stree* 

Real-time  eimulation  ha*  also  bsen  smploysd  to  asses*  strsss  (crump,  1979).  Varioun  studisa  have  triad 
bshavioural,  physiological,  bioohemioal,  or  subjsotive  measures.  The  euaoeptihi lity  to  litres*  may  be 
related  to  personality  oharaotsrietiaa  whioh  oannot  b*  sxprtasad  hy  aystsm  measures  hut  only  hy  aseess- 
msnta  of  th*  Individual.  Soms  stresa-relatsd  effsot*  of  the  ayatsm  on  tha  men  are  long  term  and  beyond 
the  loop*  of  real-time  eimulation.  Insofar  aa  sires*  is  oonetrued  ae  a  product  of  exoaanlv*  demands  on 
the  man,  real-time  simulation  may  he  used  to  assets  th*  effeots  of  oertain  proposed  system  ohanges  on 
stress  indirectly  in  term*  of  task  demands. 

5.5.  Boredom 

Boredom  show*  every  sign  of  becoming  a  more  serious  problem  in  future  system*  as  an  unwanted  incidental 
ooniequenoe  of  further  automated  aasiatanoc.  Its  oauate  and  effects  are  not  well  known  (Hopkin,  1979). 
There  is  therefore  a  need  to  develop  means  for  studying  it  in  order  to  ssasa*  it*  oonwequsno**  end 
perhaps  to  prevent  it.  Real-time  eimulation  seams  unlikely  to  be  a  suitable  tsohniqu*.  The  participants 
in  real-time  aimulationn  are  placed  in  an  uifsmiliar  and  intriguing  environment,  for  a  limited  time  with 
short  work  periods!  euoh  factors  mitigate  against  the  ooourrenee  of  boredom.  If,  nevertheless,  boredom 
oooutb  in  rwal-tiiuu  simulation,  it  may  merely  end  tho  willing  collaboration  of  th*  participants.  . 

5.6.  Attitude* 

Attitudes  towardu  tasks  may  alio  be  measured  in  real-time  simulation.  Suoh  measured  have  to  be  treated.  ' 
with  some  oaution  since  th*  attitude*  developed  during  th*  brief  expowur#  to  a  new  task  in  ri->al-tim* 
eimulation  may  not  be  representative  of  the  attitudes  to  ths  resl-llfs  task  after  full  task  proficiency 
hao  been  developed  and  the  novelty  of  thu  simulation  has  wom  off.  Nevertheless  eubjeotive  assessments 
of  the  acceptability  of  th*  task  may  bs  obtained  during  real-time  simulation.  Real-time  simulation  oan 
be  used  far  more  than  it  haB  been  to  explore  what  attribute!  of  tuskw,  equipment  and  environmental 
conditions  are  aooeptabl*  to  users  and  engender  favourable  ettltudee  (Hopkin,  1975).  However,  it* 
relevano*  to  th*  study  of  attitude  formation  lias  limit*  1  peer  pressure,  for  example,  may  utrrngly 
inflismoo  attitudes  but  not  be  amenable  to  study  by  real-ttme  eimulation  methods. 

6.  0CHCLU8I  CMS 

Although  in  thio  paper  real-time  eimulation  has  been  tppralssd  in  relation  to  large  man-raaohin*  ay o turns, 
and  particularly  to  air  traffio  oontrol  eystema,  moot  of  th*  vommuntu  mad*  nppear  to  bo  true  for  real¬ 
time  simulation  in  general  and  therefor*  may  rsmain  valid  in  other  oontext*. 

Real-timi  simulation  has  btsn  inadequately  integrated  with  other  available  teonniquos,  with  thuorstical 
oonoept*  on  whioh  it  oould  be  baaed,  with  exploratory  Btudlss  whioh  should  precede  it,  and  with 
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verifioations  whioh  oho  via  follow  it.  Sometimes  It  seams  to  have  been  used  not  because  it  ie  the  best 
method,  but  simply  because  it  was  available.  The  diversity  of  its  applioatlonn  svggatts  that  its  usage 
has  been  somewhat  unciitioalj  this  diversity  also  points  to  great  (though  miaplaoed)  faith  in  real-time 
simulation  as  a  teohniquo.  The  tendency  to  adopt  real-time  simulation  as  a  technique  for  tackling 
almost  every  problem  oannot  be  justified  on  soientifto  crowds  nor  in  relation  to  the  findings;  which  have 
been  obtained  hitherto  by  using  it . 

Real-time  simulation  should  never  be  an  end  in  itself)  its  value  orruiot  be  judged  in  isolation.  The 
purpose  of  simulation  is  to  gain  insight  into  the  fmotione  of  a  proposed  real-life  system  or  to  try  and 
replicate  aspeots  of  real-life  in  order  to  study  them  where  variables  oen  be  properly  controlled.  The 
findings  from  any  real-time  simulation  are  therefore  of  limited  interest  in  their  own  right)  their 
interest  depends  partly  on  showing  their  relevanoo  to  real-life  eyeteme.  Retd-time  simulation  oen  never 
replioate  exactly  every  relevant  aspeot  of  real-life. 

It  is  doubtful  if  some  topios,  such  aa  system  oapaoity  end  workload,  pan  be  studied  validly  by  real-time 
simulation.  Other  topios,  suoh  as  peer  pressure  and  boredom,  seem  beyond  its  toope  altogether. 

Real-time  simulation  oan  nevertheless  be  an  effsotive  aid.  Some  kinds  of  information  oen  be  obtained  by 
no  other  means.  It  oan  verify  the  suitability  of  physical  environment!  and  works  paces.  It  oan  establish 
the  intrinsio  feasibility  of  new  ideas  end  methods,  and  assist  thwm  to  evolve.  When  properly  used,  it 
oen  provide  descriptions,  insights,  end  explsnatione  of  how  a  system  ie  functioning  because  variables  oen 
be  defined  and  isolated  so  that  their  direot  effeete  and  their  interactions  oen  bo  disentangled.  It  oan 
be  used  to  explore,  and  to  make  comparisons.  It  can  be  used  to  correct  inherent  sources  of  bias  in 
evaluations,  and  to  reveal  the  kinds  of  error  to  be  expected. 

The  above  reasons  lead  to  the  general  conclusion  that  uu  a  technique  real-time  simulation  ie  both 
indispensable  and  ovsruaed. 
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SUMMARY 


The  autonomous  operation  of  several  air  defence  weapon  systems  often  leads  to  a  simultane¬ 
ous  multiple  fight  against  the  same  target,  which  in  most  oases  effects  an  overkill.  Co¬ 
ordination  of  target  allocation  multiplies  the  efficiency  of  air  defence  systems.  For  the 
fire  coordination  this  presupposes  the  unambiguous  knowledge  of  the  air  situation.  This  air 
situation  is  acquired  by  a  surveillance  network  consiating  of  up  to  20  mobile  radar- posts. 
Communication  between  the  posts  in  a  meshed  network  requires  the  solution  of  aontrol 
problems,  such  as  data  correlation  and  reduction,  and  feedback  filtering.  If  communication 
is  performed  by  HF-data  links,  like  in  the  system  described,  radio  transmission  problems 
arise  additionally.  Radio  range,  transmission  reliability,  and  channel  coding  for  the 
correction  of  corrupted  data  become  an  important  factor  for  system  operation.  For  the  pur¬ 
pose  of  obtaining  both  ,  a  complete  radar  coverage  of  the  surveillance  area  and  a  multiple 
meshed  network,  the  determination  of  the  radar  post  locations  has  to  consider  radio  and 
radar  rungeu  near  the  eerth ' n  surface  with  renpect  to  the  topographical  environment.  For 
avoiding  mutual  jamming,  the  radio  and  'radar  frequencies  of  tach  post  have  to  be  ooordi- 
natad  with  those  of  all  posts  within  radio  oi  radar  range,  respectively.  Tracking  algo¬ 
rithms,  performed  by  the  tracking  aomputur  at  each  post  provide  for  automatic  track  ini¬ 
tiation  and  tracking  even  of  jammers.  Their  design  has  to  consider  the  reliability  of 
radar-derived  data,  that  clutter  and  hostile  radar  jamming  do  not  confuse  target  tracks. 

In  order  not  to  restrict  the  high  mobility  of  the  radar  ports ,  the  algor ithmo  havo  to  oope 
with  network  failures  and  reconfigurations.  The  operation  of  the  surveillance  network  and 
of  the  weapon  systems,  inducing  the  coordination  of  their  allocation,  raises  a  lot  of  C1- 
problems.  This  paper  deals  with  the  problems  themselves  and  with  an  approach  to  their 
solution  as  follows: 

-  modelling  of  air  situations,  radar  sensor  features,  weapon  system  features,  and  imitation 
of  data  links 

-  design  of  tracking  and  allocation  algorithms 

-  simulation  of  network  operation,  accompanied  by  iterative  improvements  of  the  algorithms 

-  simulation  of  weapon  system  operation,  including  coordination  of  target  allocation 

-  testing  the  system  performance  by  means  of  radar-derived  data. 

The  approach  described  has  enabled  a  cost-effective  solution  of  the  problem*  indicated.  The 
development  risk  has  been  reduced  to  tt  level  tit  which  implementation  of  the  system  is 
guaranteed. 

1  .  SYSTEM  CONFIGURATION 

The  radar  network  consists  of  10  to  20  mobile  posts  with  overlapping  radar  coverages 
(Fig.  1)  to  attain  a  good  system  detection  probability  for  extremely  low-flying  aircraft  at 
terrain  following  or  terrain  avoidance  flight  profiles.  The  variable  position#  of  the  poets 
will  be  primarily  chosen  wi .h  the  aim  of  a  complete  radar  coverage  of  the  entire  area  of 
interest  with  special  regard  to  lowest  level  flight  profiles  /I/. 

Since  the  network  requires  no  central  coordinating  and  processing  station,  a  broad  spectrum 
of  possible  system  configurations  can  be  handled.  Ir.  order  to  avoid  restrictions  on  nyjtein 
flexibility,  and  to  be  resistant,  against  failures  of  radar  poste,  neighbouring  posts  are 
interconnected  by  HF-data  links  (Fig.  2).  Tracking  is  performed  identically  in  each  radar 
post.  Each  radar  post  has  to  accomplish 

-  target  detection 

-  data  extraction 

-  data  correclatlon 

-  track  determination 

-  data  distribution  and 

-  display  of  air  situation 

According  to  those  tasks,  uach  post  is  equipped  with  (Fig.  3) 

-  a  radar  sensor  including  a  data  extractor 

-  a  communication  Bet  ( transmitter /receivers,  coUing/decoding  units) 

-  a  tracking  computer  (TC) 

-  a  display  unit 

Computed  track  information  is  transmitted  and  simultaneously  displayed  on  a  digital  diopiay 
unit.,  Thin  enables  the  operator  to  check  tracking  results  and,  on  demand,  to  classify 
targets  (friend,  unknown,  mass  approach,  jammer).  Due  to  the  requirement  for  target 
allocation  to  weapon  systems,  trucks  must  have  a  maximum  life  time  and  minimum  data  ageing. 
In  the  best  case,  the  data  age  is  less  than  1  second.  The  track  update  rate  varies  between 
1  to  4  messages  every  3  seconds. 


Because  the  track  Information  at  every  post  reflects  the  same  air  situation,  usets  can  tune 
their  receivers  to  any  post  which  is  most  convenient  to  them. 

2.  PLANNING  OF  SYSTEM  OPERATION 

The  EDP-baeed  procedures  for  operational  planning  of  the  surveillance  system  aim  at 
adapting  the  planning  methods  to  the  mobility  of  the  surveillance  network. 

New  planning  procedures  must  mainly  be  employed  for  the  following  tasks i 

-  radar  post  location  planning  (radar  coverages) 

-  network  configuration  planning  (radio  links) 

-  frequency  coordination  (radio  and  radar) 

2.1  Radar  Post  Location  Planning 

The  objective  of  sensor  position  planning  is  to  determine  those  locations  for  the  indi¬ 
vidual  radar  posts  of  ths  network  which  enable  a  maximum  complete  total  surveillance.  The 
principle  of  generating  rudar  acquisition  diagrams  is  to  determine  the  respective  radar 
lines  of  sight  as  a  function  of  an  assumed  target  altitude  for  the  total  360*  scan 
(Fig.  4). 

Up  to  now,  radar  acquisition  diagrams  were  generated  manually  with  the  help  of  terrain 
profiles  obtained  from  maps.  For  the  purpose  of  obtaining  a  result,  in  this  procedure  In 
infinite  time,  the  angular  resolution  was  chosan  to  be  relatively  coarse  (Fig.  5). 

EOP-based  procedures  rely  on  a  digital  terrain  data  base  and  are  capable  of  generating 
radar  acquisition  diagrams  of  a  much  better  resolution  and  within  considerably  shorter 
time. 

The  following  aspects  have  to  be  clarified  in  the  course  of  simulation  activities  for  EDP- 
based  sensor  position  planning i 

-  optimum  structure  of  the  terrain  data  base.  At  a  coordinate  resolution  of  250  m,  and  at 
an  alavation  resolution  of  1  m,  the  data  base  contains  about  1  M  byte  per  area  of 

100  km  x  100  km. 

-  optimum  procedure  for  determining  new  positions  for  the  radar  network  within  a  short 
time. 

-  suitable  manner  of  representation  of  tho  acquisition  diagrams,  especially  of  the  repre¬ 
sentation  of  the  total  network  coverage. 

2.2  Network  Configuration  Planning 

Keeping  the  radar  post  on  the  locations  determined  in  the  preceding  workshop,  network 
communication  planning  is  required  to  obtain  the  best  possible  communication  network)  Its 
objective  is  to  determine  multiple  redundant  radio  links  batwsen  neighbouring  posts, 
regarding  the  following  conditions* 

-  each  post  transmits  Information  at  a  single  frequency  to  neighbouring  posts,  with 
omnidirectional  characteristics 

-  each  post  receives  up  to  three  neighbouring  posts  on  three  receivers >  the  recaption  of 
2  neighbouring  posts  shall  be  possible  in  any  case. 

The  procedure  of  network  configuration  planning  provides  for  an  initial  classification  of 
all  possible  radio  links  between  neighbouring  posts  with  regard  to  their  transmission 
performance  (Fig.  6  and  Fig.  7) , 

Essential  parameters  regarding  the  performance  of  a  radio  transmission  path  are  -  tr. 
addition  to  the  equipment  performance  characteristics  -  the  distance  and  the  terrain 
profile  between  the  posts,  The  influence  uf  tho  terrain  is  covered  in  an  approximation 
solution  with  the  help  of  the  "shadowing  height".  The  "shadowing  height"  will  bo  determined 
via  the  digital  terrain  model. 

Radio  links  to  be  provided  will  bo  selected  according  to  the  following  approach i 

-  in  an  initial  step,  those  posts  are  soleated,  to  which  only  two  linking  possibilities 
with  neighbouring  posts  exist.  Depending  on  the  case,  also  radio  links  of  lower  quality 
have  to  be  used  in  connection  with  these  posts. 

-  in  step  no.  2,  additional  fcadio  links  with  good  transmission  performance  are  selected  for 
each  post. 

-  in  step  no.  3,  the  network  configuration  1b  completed  by  the  selection  of  additionally 
possible  radio  links,  with  a  limit  of  three  receiving  channels  for  each  post.  This 
completion  effort  may  contain  unidirectional  links. 
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3 .  COMMUNICATION 

Data  communication  is  realised  by  transmitting  track  data  omnidirectionally  to  every 
other  radar  post  within  radio  range.  Three  receivers  at  each  post  permit  the  configura¬ 
tion  of  a  multiple-meshed  network  with  the  advantage  of  multiple  redundant  data  trans¬ 
mission.  In  most  oases,  data  links  between  two  posts  are  bidirectional.  A  unidirectional 
data  link  is  given,  if  at  one  of  two  communicating  posts  all  receivers  are  tuned  to 
othor  posts  or  if  radio  disturbances  of  the  reoeived  frequency  are  present. 

The  tracking  computer  distinguishes  between t 

-  Target  reports  from  its  radar 

-  Track  messages  containing  a  preliminary  track  number 

-  Track  massages  aontaining  a  final  trank  number. 

Target  reports  contain  the  following: 

-  target  position 

-  target  altitude  (3D-radar  only) 

-  date  of  measurement 

-  type  of  target, 

Track  messages  contain  additionally: 

-  track  number  (preliminary  of  final) 

-  target  velocity 

-  track  quality. 

Target  reports  themselves  will  not  be  distributed  externally  but  they  trigger  the 
distribution  of  track  messages.  Track  messages  containing  a  preliminary  track  number  ere 
distributed  as  quickly  as  possible  to  all  posts  in  order  to  shorten  the  preliminary 
tracking  phase  (see  4.1.5). 

Figure  8  shows  the  radar  plots  derived  from  four  radars,  detecting  three  targets.  Each 
radar/ tracking  post  has  to  process  all  radar  plots  from  it*  own  radar  and  all  traak 
messages  from  the  three  other  posts. 

Regarding  the  data  reduction  task,  it  has  to  be  pointed  out  that  each  post  has  4  data 
input  channels  (Fig.  3),  but  only  one  output  channel  with  a  capacity  equal  to  each  input 
channel.  Therefore,  on  an  average  only  a  quarter  of  all  reported  messages  can  be  relayed. 
For  reducing  the  quantity  of  messages  circulating  in  the  network,  eaoh  post  forwards 
messages  only,  if  the  corresponding  registered  track  Is  being  updated  or  if  its  track 
number  is  being  changed  by  that  message.  In  this  way,  feedbacks  are  recognized  and 
eliminated. 

The  transmission  capacity  of  the  specified  hardware  limits  the  message  rate  per  target, 
Therefore  only  those  massages  are  forwarded  that  prolong  a  track  by  at  least  k  seconds 
(k  «  1  s/message  rate)  with  respeat  to  the  last  message.  The  forwarded  message  is  updated 
and  contains  the  most  reoent  smoothed  track  data.  In  order  to  reduce  ageing  of  messages 
on  their  way  through  the  network,  radar  returns  get  priority  above  messages  reoeived  via 
data  link  in  triggering  new  messages  (Fig.  9).  Fortunately,  the  rotation  rate  of  most  of 
the  radar  nntennis  in  the  system  is  twice  of  the  massage  rata  required  for  each  target. 
Consequently,  each  radar,  which  detects  a  target  cauBoe  the  l'C  to  trigger  its  message 
clearance  at  every  other  antenna  rotation.  So,  aguing  of  messages  occurs  almost  exclusive 
ly  »t  stations  whiah  do  not  detect  the  target  concerned.  In  the  case  that  a  target  return 
is  missed,  thu  next  available  message  -  from  radar  or  via  data  link  -  will  trigger  the 
transmission  of  the  new  message. 

4.  SIMULATION  OF  THE  SURVEILLANCE  NETWORK 

In  multiple  radar  networks,  where  the  dispersion  of  the  radar  posts  is  dense  with  respect 
to  their  individual  radar  coverages,  an  incoming  target  may  often  be  detected  be  several 
radar  sensors  almost  simultaneously.  When  the  network  consists  of  radar  posts  with 
aollocated  tracking  facilities  of  equal  . uthority  in  order  not  to  require  a  central 
processing  station,  while  the  capacity  of  the  data  links  and  of  the  track  data  processors 
are  limited,  track  initiation,  tracking  and  management  cannot  be  performed  effectively  by 
conventional  methods. 

4.1  Tracking  Algorithms 

Tracking  is  realised  simultaneously  in  each  radar  post,  even  if  it*  own  sensor  does  not 
detect  the  target.  Tracking  algorithms  provide  for  a  unique  track  with  an  unambiguous 
track  number  at  ail  ponts  for  every  target  entering  into  the  system  surveillance  coverage 
even  if  it  is  detected  by  several  radars  simultaneously.  The  system  track  number  is  kept 
unamblguo-jo  even  if  target  trajectories  are  crossing.  Tracking  of  target  formations  is 
limited  only  by  the  resolution  capabilities  of  the  radars.  In  the  presence  of  jammers, 
their  bearings  will  be  tracked  and  thoir  positions  will  be  triangulated.  Fig,  10  shows 
the  combined  evaluation  of  bearings,  plots  and  trackB. 

4.’.1  Data  Proceaoing 

Target  data  delivered  by  radar  and  track  messages,  which  have  been  received  from  neigh- 
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bouring  posts  via  data  link  have  quite  different  features.  Radar-derived  data  are  most 
recent,  but  they  contain  less  information  (Fig.  11)  and  are  less  reliable  than  track 
messages,  which  are  already  filtered.  For  evaluating  both  kinds  of  information  in  an 
optimum  way,  two  separate  filters  are  implemented  in  the  tracking  computer. 

The  plot  filter  correlates  exclusively  target  reports  derived  from  the  radar  of  the  post 
conosrned,  and  initiates  and  maintains  sensor  tracks  by  alpha/beta-f iltaring. 

All  sensor  tracks  of  one  single  post  form  the  sensor-derived  air  situation  of  this  post. 
The  total  of  all  tracks  of.  the  surveillance  network  forms  the  system-derived  air 
situation.  Sensor  track  messages  contain  the  same  amount  of  information  as  system  track 
messages. 

The  track  filter  correlates  both,  sensor  track  data,  and  system  track  data  received  via 
data  link,  with  the  registered  system  track  data  to  update  the  system  track.  This  is  per¬ 
formed  by  an  alpha/bata-f ilter  with  dynamic  coefficients  depending  on  the  track  quality. 
Parameters  for  the  determination  of  the  track  quality  ares 

-  the  age  of  a  track, 

-  the  track  status  (preliminary  or  confirmed) , 

-  the  amount  of  associated  and  correlated  target  reports  from  the  collocated  radar, 

-  the  amount  of  correlated  track  messages  received  via  data  link, 

-  the  time  elapsed  since  the  last  updating. 

There  are  many  advantages  in  filtering  radar-derived  data  separately  from  the  other 
system  track  data  received  via  data  link  / 4 / ,  /S/. 

Firstly,  all  radar-derived  data  from  one  post  have  a  constant  systematic  bias.  By  corre¬ 
lating  only  target  data  from  the  same  radar  the  bias  does  not  affect  on  plot  associations. 
This  increases  the  probability  of  a  correct  association  of  successive  target  reports. 

secondly,  the  constant  bias  and  the  adequate  sampling  time  of  the  radar  antenna  improve 
the  computation  of  the  target  velocity.  If  traak  positions  receivad  via  data  link  were 
utilized  for  tho  velooity  computation  instead,  two  problems  would  arise i 

-  different  biases  of  detecting  radars  would  run  up, 

-  by  utilization  of  messages  one  shortly  after  the  other,  the  radar  measurement  error  can 
be  of  the  aamo  magnitude  or  greater  than  the  distance,  the  target  has  flown  in  the 
meantime. 

Both  problems  result  in  an  error  of  the  computed  target  velooity  followed  probably  by  a 
wrong  association. 

Both  advantages,  i.e,  correct  associations  coupled  with  improved  velooity  computations 
lead  to  a  smoothed  track  oi  good  quality  and  high  reliability. 

4.1.2  Plot  Association 

Every  target  detection  by  radar  is  reported  to  the  tracking  computer  which  tries  to 
allocate  tho  target  report  to  a  suitable  existing  track  (Fig.  12) .  For  the  association  of 
radar  plots  to  an  existing  sensor  track,  positions,  altitudes,  velocities  and  measurement 
dates  are  checked.  Information  about  the  target's  identity  / 2/ 3/  is  compared  only  to 
disentangled  track  confusion  due  to  crossing  trajectories  etc.  If  the  reported  target  is 
positioned  within  the  expected  window  of  the  predicted  registered  track,  it  will  be 
associated.  If  there  is  no  correlation  between  the  reported  radar  plot  and  any  registered 
target  track,  the  tracking  computer  (TC)  tries  to  initiate  a  new  track.  It  stores  the 
reported  plot  data  into  a  track  register  (TR)  (Fig.  13)  for  a  possible  association  with  a 
plot,  expected  during  tuc  next  rotation  of  the  radar  antenna,  In  the  absence  of  the 
expected  second  plot  report,  the  plot  is  assumed  to  be  a  false  target  report,  and  its 
data  in  the  TR  will  be  eliminated.  If  the  used  radars  have  a  small  detection  probability, 
a  third  antenna  rotation  can  be  tolerated  for  a  second  detection  oi  the  target.  If  the 
radar  does  report  suitable  plots  in  consecutive  antenna  periods,  they  will  be  joined  to  a 
potential  track. 

After  the  association  of  three  plots  within  three  consecutive  antenna  turnarounds,  a 
track  message  with  a  preliminary  track  number  is  externally  distributed  initially.  For 
each  association  chock,  the  plot  data  derived  from  a  2D-radar  will  be  slant  range 
corrected.  The  slant  range  error  is  the  difference  between  the  measured  slant  range  to 
tho  target  and  the  length  of  tho  line  of  Bight  projection  onto  that  horizontal  plane, 
which  contains  the  radar'B  position  (Fig,  14).  At  large  elevation  angles,  the  slant  range 
error  may  amount  to  30  %  of  the  slant  range.  If  height  information  is  missing,  the 
moasured  slant  range  must  be  interpreteu  as  the  horizontal  range.  This  may  result  in 
shifts  of  the  computed  target  position  and  in  bendings  of  ths  track,  If  the  slant  range 
error  io  large  enough  to  uffoot  association,  a  new  track  will  be  initiated,  so  that  the 
same  target  is  tracked  twice.  For  slant  range  correction,  heigth  information  from  any  30- 
radar  or  SSR-information  can  be  used. 

4.1.3  Track  Association 

Each  tracking  facility,  which  receives  a  track  message,  checks  whether  that  track  is 
associable  to  a  track,  which  is  already  stored  in  its  TR  (Fig.  15).  At  first  it  looks 
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for  the  reported  traak  number.  Tf  the  TC  finds  it  in  its  TR,  it  checks  whether  the 
reported  target  belongs  to  the  stored  traok.  If  the  TC  cannot  find  the  same  track  number, 
or  if  there  is  no  correlation  between  the  tracks  with  the  same  track  number,  it  checks 
all  registered  tracks  to  correlate  the  received  track  information  with  the  most  suitable 
track.  In  order  to  enhance  the  survivability  of  confirmed  tracks,  they  are  preferred  to 
preliminary  tracks,  for  the  association.  If  there  is  no  correlation  even  to  a  preliminary 
track,  the  received  track  message  is  added  to  the  other  tracks  in  the  TR  and  forwarded 
via  data  link  to  all  neighbouring  j-osta.  In  the  case  of  an  association  of  two  trao -a  with 
different  track  numbers,  a  trach  number  harmonisation  procedure  provides  for  an  unambig¬ 
uous  final  track  number  * •  a1'  .racking  posts. 

Associated  track  data  wilo,  oe  used  to  update  the  appropriate  track,  provided  that  the 
received  target  information  is  more  recent  than  the  stored  track  information.  Older  mes¬ 
sages  will  be  disregarded.  After  updating,  a  track  message  containing  the  most  recent 
track  data  is  transmitted  to  neighbouring  poses  in  accordance  with  the  track  reporting 
procedure  (see  3) , 

"’racks  will,  be  aarried  on  in  all  posts  as  long  as  the  target  is  detected  by  at  least  one 
radar.  After  a  target  ie  misted  for  a  fixed  time  period,  the  track  will  be  terminated 
(fig.  13) .  This  time  period  is  determined  by  the  slowest  antenna  turn  rate  of  the  radars 
used,  in  order  to  give  the  collocated  TC  a  ohanae  to  continue  tracking  in  spite  of 
missing  a  target  once.  It  is  not  expedient  to  wait  any  longer  for  a  radar  plot,  because 
the  prediction  quality  decreases  rapidly  and  the  track-window  for  the  expected  plot 
position  would  have  to  be  enlarged  accordingly.  In  a  dense  air  situation  this  increases 
the  probability  of  a  false  association. 

4.1.4  Jammer  Tracking 

In  the  presence  of  jammers,  the  radar-derived  bearings  are  tracked  automatically.  Bearing 
association  and  tracking  is  performed  similarly  to  regular  echo  target  tracking  with 
different  parameters.  Since  all  posts  distribute  their  tracked  bearings  to  all  other 
posts,  the  jammer's  position  can  be  determined  by  intersection  calculations  (Pig.  10). 

h-1 

Because  n  bearings  can  generate  max.  intersections,  not  every  intersection  repre¬ 

sents  a  jammer,  even  if  only  few  jammers  are  present.  Ghost  targets  are  eliminated  by 
demanding  a  minimum  of  intersections  being  close  together  for  the  definition  of  one 
single  jammer.  Because  of  inaccurate  bearing  measurement*,  intersections  can  accumulate 
accidentially  at  wrong  positions.  Special  methods  and  algorithms  ara  used  to  determine 
the  correct  jammer  position.  The  calculated  jammer  positions  are  evaluated  like  regular 
echo  target  plots  for  track  initiation  and  tracking.  If  intersections  are  located  near  to 
a  regular  target,  it  is  assumed  to  be  a  jammer. 

4.1.5  Track  Number  Management 

Track  number  management  provides  for  identical  track  numbers  for  every  target  track  in 
each  radar  post,  it  is  activated  in  two  cases i 

-  '"or  harmonizing  different  track  numbers  concerning  the  same  preliminary  track 

ir  rechanging  final  track  numbers  in  a  predefined  way  in  all  posts  if  numbers  of  con¬ 
firmed  tracks  have  been  exchanged  by  mistake. 

Harmonization  of  Preliminary  Track  Numbers 

Due  to  the  overlapping  coverage,  many  incoming  targets  are  initially  detected  by  several 
radar  sensors  at  almost  the  same  time.  Each  radar  post,  which  detects  a  target  three 
times  in  subsequent  detection  cycles,  distributes  a  track  message  with  a  preliminary 
track  number.  Each  post  has  a  specific  prefixed  pool  of  track  numbers,  so  preliminary 
track  numbers  assigned  by  different  postB  are  always  different. 

If  a  post  associateB  two  tracko  which  are  identical  but  have  different  preliminary  track 
numbers,  the  track  management  ejects  the  smaller  number  to  survive.  The  track  message, 
which  is  forwarded  contains  the  most  recent  track  data  but  the  smaller  track  number. 

Depending  on  the  network  deployment,  a  message  needs  a  certain  minimum  of  time  to  reach  all 
posts.  A  period  of  twice  of  this  time  (pre-phase  period)  is  sufficient  for  the  harmoniza¬ 
tion  of  different  track  numbers,  related  to  the  same  target.  At  tne  end  of  this  period 
each  message  concerning  this  particular  target  contains  a  unique  final  track  number. 

Rearranging  Ambiguous  Final  Track  Numbers 

A  puzzling  situation  arises,  in  every  tracking  mechanism  when  targets  fly  crossing 
trajectories  or  when  targets  split  up  after  flying  in  close  formation.  Consequently, 
track-numbers  tend  to  be  swapped  (track  A,  number  A  and  track  B,  number  B  change  into 
track  A,  number  B  and  track  B,  number  A  respectively) ,  or  track  numbers  are  doubled  (two 
tracks  with  the  same  number) ,  or  tracks  will  be  doubled  (one  targot,  two  tracks  with  two 
numbers) .  For  restoring  the  unambiguity  of  final  track  numbers,  each  post  induces  a 
harmonizing  track  management  procedure,  which  rearrange  track  numbers  in  a  prsdetermined 
way , 

If  the  radar  accuracy  is  less  than  the  separation  of  the  targets,  neither  the  radar  data 
extractor  nor  a  human  operator  can  decide,  which  of  the  reported  radar  plotB  belongs  to 
which  targot.  In  view  of  this  fact,  targets  flying  closely  together  or  flying  crossing 
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trajectories  are  tracked  separately  with  different  track  numbers,  but  the  unambigu.tky 
cannot  be  guaranteed.  This  lack  la  not  critical  for  system  operation,  since  the  over¬ 
riding  point  for  a  simultaneous  track  data  processing  is  that  all  posts  keep  the  same 
number  for  the  identical  track,  even  if  targets  are  exchanged.  Recognizing  this,  a  very 
simple  changing  procedure  is  chosen  to  save  computing  time.  Examples  of  simple  changing 
critaria  are  as  follows: 

-  the  target  flying  the  most  Southern  track  gets  the  smaller  track  number, 

-  if  both  targets  fly  at  the  same  latitude,  the  target  flying  the  most  Western  track  gets 
the  smaller  track  number. 

4.2  Models 

4.2.1  Air  Situations 

In  accordance  with  the  demanded  system  performance,  the  surveillance  network  has  to  oops 
with  more  than  100  targets.  Most  of  the  targets  are  assumed  to  manoeuver  with  lateral 
accelerations  up  to  3  g  at  speeds  of  about  Mach  1  and  at  very  low  altitudes.  Aircraft  at 
higher  altitudes  are  assumed  to  fly  at  a  maximum  speed  of  up  to  Mach  3.  Some  of  thon.  ara 
friendly,  others  are  of  unknown  identity.  Jammers  are  of  stand-of  (SOJ) ,  self-screening 
(SSJ) ,  and  of  ecort  (ESJ)  type.  The  jammed  sector  in  front  of  the  jamming  aircraft  can  be 
varied. 

Three  basic  models  were  developed.  In  order  to  simulate  a  wide  spectrum  of  air  situations, 
each  model  can  be  modified  in  its  parameters.  In  some  simulation  runs  e.g.  some  targets 
became  jammers,  or  single  targets  were  substituted  by  formation  flights  with  various 
numbers  of  aircraft. 

A  fourth  air  situation  modwl  of  the  STC  was  tested  with  regard  to  ita  usefulness,  but  it 
was  proved  that  it  requires  lsss  comfortable  algorithms  than  the  first  three  onea. 

4.2.2  Radar 

In  order  to  detect  all  targets,  in  low  level  flight  and  in  the  upper  airspace,  different 
types  of  radar  sensors  with  different  performance  are  aombined. 

About  3  mobile,  3D-phased  array  radars  are  used  to  survey  the  whole  area  of  interest.  The 
azimuthal  saan  is  performed  mechanically.  It  has  a  theoretioal  range  of  100  km,  which 
causes  an  antenna  rotation  rate  of  about  6  r.p.m.  The  good  target  resolution  of  this 
radar  enables  the  discovery  of  single  aircraft  flying  in  formation  with  the  advantage  of 
a  quick  and  distinct  track  reaction  upon  splitting  up  formations. 

Beoauae  of  the  earth's  curvature,  extreme  low-flying  targets  at  distances  greater  than 
40  km  are  hidden  behind  the  radar  horizon.  Therefore,  additionally,  a  lot  of  highly 
mobile,  mechanical  scanned,  2D-radars  is  dispersely  located  to  detect  aircraft  at  terrain 
following  or  terrain  avoidance  flight  profiles.  These  radars  are  designed  especially  for 
lower  airspace  surveillance  within  a  range  of  max.  30  km.  For  clutter  auppression  a 
doppler-type  radar  sensor  was  chosen  with  alternate  pulse  repetition  frequencies  (p.r.f.) 
at  consecutive  antenna  rotations.  The  radar  model  pays  regard  to  this  fact  by  providing 
different  blind  velocity  ranges  dependent  on  the  p.r.f.  The  radar  antenna  rotates  at 
40  r.p.m.  Targe*  resolution  and  data  accuracy  are  smaller  than  in  the  case  of  the  3D- 
radar . 

Radar-derived  false  alarm  plots,  which  are  uniformly  dispersed  over  the  radar  surveil¬ 
lance  coverage  are  added  to  the  radar  output  according  to  rates  stated  by  the  radar 
manufacturers. 

Unfavourable  positioning  of  the  mobile  radar  posts  may  reduce  the  acquisition  range  near 
the  ground  to  a  few  kilometers  (Fig.  16) .  This  circumstance  is  considered  by  modelling 
different  radar  coverages  varying  in  height  level  and  azimuth.  A  digital  model  of  the 
area  of  interest  can  be  used  to  compute  exact  radar  coverages  (bob  2,1), 

4,3  Simulation  Steps 

The  simulation  was  performed  in  three  steps.  The  first  stop  wbb  to  prove  the  ability  of 
the  algorithms  to  track  targets  of  modelled  relevant  air  situations.  The  second  step 
proves  the  realtime  capability  of  the  tracking  algorithms  implemented  in  a  process 
computer.  Finally,  models  of  the  air  situations  and  of  the  features  of  the  radars  are 
replaced  by  real  air  situations  acquired  by  radar  sensors  under  real  conditions. 

1.3.1  Proving  the  Algorithms 

In  order  to  prove  the  principal  function  of  the  tracking  algorithms,  the  surveillance 
network  and  relevant  air  situations  are  modelled  by  means  of  computer  programs  and  are 
implemented  in  a  large-scale  computer. 

The  following  failures  of  radar  post  components  have  been  analysed  with  respect  to  their 
effect  on  surveillance  system  operation! 

-  receiver  failure  (post  transmits  solely  sensor  track  messages) 

-  radar  sensor  failure  (relay  function  remaining) 


-  total  failure  (network  splitting  possible) 

The  simulation  results  are  plotted  graphically.' 

During  the  simulation  runs,  algorithms  wore  Improved  and  parameters  were  adjusted.  At  the 
end  of  the  runs,  it  was  shown  that 

-  all  tracks  are  initiated  in  spite  of  false  target  reports  as  well  as  expected, 

-  the  amount  of  false  tracks  due  to  false  target  reports  stay  within  the  required 
limitations  of  less  than  1  %, 

-  the  track  quality  increases  rapidly  after  initiation  and  remains  high  even  at  confuting 
target  manoauvors, 

-  track  numbers  are  managed  unambiguously, 

-  difficult  air  situations,  such  as  crossing  trajectories,  formation  flightB,  and  tempo- 
rary  hidden  terrain  following  flights  are  controlled  successfully, 

-  operational  constraints  during  build  up,  change  or  decomposition  of  tho  tracking 
network,  such  as  net  splitting  and  reformation,  or  the  connection  of  additional 
compatible  networks  are  practicable  during  system  operation  ana  do  not  aausa  any 
confusion  or  operational  restrictions, 

-  the  sensitivity  of  the  surveillance  system  to  failures  of  radar  posts  or  of  components 
of  them  is  very  small. 

Figure  17  shows  the  tracking  of  two  targets,  flying  crossing  trajectories  at  equal 
altitude.  The  first  intersection  is  rectangular,  the  second  one  is  at  an  angle  of 
45  degrees.  Track  numbers  do  not  change  in  spite  of  crossing.  Due  to  the  great  number  of 
simulated  false  radar  echos,  some  false  preliminary  tracku  appear  but  terminate  after  the 
first  report,  with  one  exception,  which  is  reported  twice  (track  number  2073) . 

Figure  18  shows  an  air  situation  with  three  formation  flights  of  four  targetB .  Each 
15  radar  posts  arc  in  operation.  After  a  certain  time  at  least  three  tracks  are  estab¬ 
lished  for  eaoh  formation.  Since  target  discrimination  by  the  radars  differs  from  rota¬ 
tion  to  rotation,  the  updating  of  the  separate  tracks  varies. 

4  .?  .2  Realtime  Test 

The  sisn  of  the  t.raaklng  computer  in  each  radar  post  is  limited  in  its  dimensions  at'-  ite 
power  oonsumption.  Some  of  its  properties  are 

-  fixed  and  floating  point  aiithmetic' 

-16  bit  word  length 

-  internal  memory  128  K  Byte,  with  provision  for  expansion 

-  directly  addressable  64  K  Byte 

-  no  auxiliary  storage 

-  sufficient  number  nf  16-bit  registers 

-  operating  speed  of  approximately  200,000  operatlons/sec, 

-  Btored  programi  the  operating  system  needs  about  30  K  byte,  the  user  program  up  to 
80  K  byte  ahd  wore,  depending  on  the  jammer  tracking  capabilities 

-  program  language i  high  level  language  for  algorithms,  assembler  for  I/O-procedures. 

For  checking  the  realtime  capability  of  the  designed  tracking  algorithms  performed  by  a 
relatively  small  process  computer,  three  AEG  80-20  computers,  similar  to  the  expected 
tracking  computer  were  interconnected  (Fig.  19).  The  data  links  were  not  modelled  but 
simulated  in  their  most  characteristic  parameters.  A  central  control  computer  imitated 
three  radar  sensors  and  supplied  the  three  tracking  computers  with  target  reports  corre¬ 
sponding  to  synthetic  air  situations.  To  get  comparable  results  from  the  large-scale  com¬ 
puter  simulation  and  from  the  process  computer  simulation,  identical  air  situation  models 
were  used.  It  was  shown  that  this  computer  can  handle  about  ion  targets,  if  the  algorithms 
described  above  are  employed.  Simultaneous  tracking  of  six  jammers  was  simulated  success¬ 
fully. 

4.3.3  Real  Input  Data  Test 

The  input  data  for  the  demonstration  of  system  function  and  for  the  real  time  test  are 
derived  from  a  synthetic  air  situation  and  modified  uncording  to  the  radars  concerned. 
Both,  the  air  situation  and  the  radar  characteristics  are  modelled  by  ESG  with  respect  of 
particularities,  specified  by  the  German  Air  Force  and  by  tho  manufacturers  of  the 
radars.  To  ensure  that  differences  between  the  models  and  the  real  air  situations  or  tho 
real  radar  performances,  respectively,  do  not  effect  the  tests  positively,  real  air 
situations  were  acquired  by  three  radar  posts  and  recorded  simultaneously  on  tapes.  The 
flight  profiles  for  21  jets  and  5  helicopters  are  planned  under  the  responsibility  of  ESG 
in  accordance  with  the  GAF  and  German  Army  pilots. 

The  recorded  data  of  the  three  radars  were  filed  chronologically  and  prepared  for  the 
replacement  of  the  synthetical  data.  The  same  configuration  of  three  interconnected 
tracking  computers  as  for  the  realtime  tent  was  used  to  prove  the  effectiveness  of  tho 
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tracking  algorithms.  The  central  control  computer  supplied  the  tracking  computers  with 
real  radar  data  as  if  they  were  acquired  in  realtime. 

The  most  important  results  of  the  simulation  runs  aret 

-  the  real  flight  profiles  were  easier  to  track  than  the  synthetical  ones, 

-  because  of  the  lack  of  radar  resolution,  tracking  of  formation  flights  i*  not  as 
critical  as  expected, 

-  clutter  is  a  severe  problem;  it  has  to  ba  eliminated  by  filter  algorithms  -  e,g. 
clutter  mapper  -  before  tracking, 

-  wrong  manipulations  of  the  operators  at  the  radar  posts,  such  as  an  insufficient  false 
alarm  suppression  or  an  incorrect  input  of  the  local  coordinates  have  to  be  taken  into 
account  when  defining  the  algorithms  and  the  operators  manual. 

5.  SIMULATION  OP  THE  FIRE  CONTROL 

\  The  optimum  coordination  of  fire  between  the  weapon  systems  that  can  be  employed  is  an 

essential  system  function.  This  task  is  performed  at  the  lowest  command  level,  i.e.  both 
throat  analyses  and  tarqot  allocation  for  the  associated  weapon  systems  -  possibly  of 
different  types  -  take  place  at  battery  level  (Pig.  20).  The  objective  of  fire  coordina¬ 
tion  is  to  avoid  overkills  of  individual  airborne  targets  and  to  obtain  an  optimum  fire 
distribution  at  a  very  low  ammunition  consumption  in  the  case  of  several  aircraft  enter¬ 
ing  . 

5 . 1  Approach 

The  sequence  of  the  simulation  activities  provides  for  two  worksteps,  l.e.  "simulation  by 
large-scale  computers"  and  "process  oomputer  simulation"  with  the  following  objectives; 

-  Simulation  by  large-scalo  computer 
o  functional  proof  of  algorithms 

o  parameter  definitions 
o  determinat  . in  of  the  ef fectivity 
o  optimisation  of  procedures 

-  Process  computer  simulation 

o  realtime  testing  of  functions/operational  sequences 
o  determination  of  the  procedure  efficiency 
o  determination  of  radio  link  load 
o  determination  of  operator  strain 
o  determination  of  computer  workload 

5.2  Models 

Pig.  21  shows  the  overall  model  for  the  simulation  of  the  fire  control.  Essential  compo¬ 
nents  thereof  are  as  follows; 

-  Air  situation  model 

The  air  situation  model  covers  both  the  actual  air  situation  to  be  referenced  for 
evaluation  purposes,  and  the  system  air  situation,  acquired  by  the  senBor  network, 

Which  is  received  and  evaluated  both  by  the  fire  control  vehicle  and  by  the  weapon 
Bystems. 

-  Fire  control  vehicle  model 

The  procedures  covering  threst  analysis  and  target  allocation  were  realized  by  the  fire 
control  vehicle.  Essential  parameters  in  the  strategy  of  target  allocation,  among 
others,  are  as  follows; 

o  behaviour  of  the  incoming  airborne  targets 
o  performance  of  weapon  systems 

o  status  of  weapon  systems,  e.g.  availability,  ammunition  supply  etc, 

-  Weapon  system  model 

The  weapon  system  model  includes  the  following: 

o  surveillance  radar,  including  terrain  shadowing 
o  action  in  the  case  of  lock-on  (probability  to  obtain  a  lock-on) 
o  weapon  release  (e.g.  model  on  salvo  sequence) 

o  determination  of  hit  probability  (inclusive  impact  on  air  situation) 
o  weapon  system  failure  behaviour  (statua),  Inclusive  ammunition  supply. 


Additionally,  models  for  simulating  data  transmission  (time  behaviour,  arising  of  inter¬ 
ruptions),  manual  interventiono,  and  for  varying  the  deployment  have  been  implemented. 


5.3  Time  Sequences 


The  situation  in  the  timely  sequence  of  threat  analysis  and  target  allocation  is  shown 
in  Fig.  22.  Incoming  targets  are  entered  in  the  intruder  log  as  coon  as  they  are  within  a 
minimum  distance  to  the  weapon  system. 

If  they  are  determined  to  bo  a  threat  during  further  surveillance  -  as  a  result  of 
analysing  their  course,  speed  and  manoeuverability  -  they  are  entered  in  the  allocation 
log.  In  Lhe  remaining  time  until  allocation  of  the  terget  to  a  weapon  system,  the 
optimum  weapon  system  for  fighting  it  has  to  be  selected  according  to  the  strategy 
program.  The  time  of  target  allocation  must  consider  both  the  weapon  effectlvety  range 
and  the  weapon  system  inherent  reaction  time  including  the  projeat'ile  time-of-f light. 

Figure  23  shows  the  data  flow  in  the  simulation  system.  Whilo  the  procedures  in  the  fire 
control  vehicle  are  fully  realized  for  simulation  purposes,  various  sequences  in  the 
weapon  avs'ems  have  to  be  simulated  by  way  of  models.  The  latter  oase  applies  in 
particular  to  the  functions  of  the  search  radar,  lock  on  and  determination  of  the  hit 
performance.  > 

5.4  Results 

Figure  24  shows  some  results  with  regard  to  quality.  The  diagrams  clearly  show  ths 
increase  in  weapon  system  effectivity  and  the  reduction  of  the  ammunition  to  be  used  when 
a  fire  coordination  is  employed.  The  possible  increase  in  effectivity  obtainable  by 
the  system  via  early  reconnaissance  and  proper  weapon  system  operational  guidance 
offers  improvement  factors  of  >2. 
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SIMBOX  »  A  GENERAL  PURPOSE  DEFENSE  SYSTEMS  SIMULATOR 


B  Davy 

Royal  Signal!  and  Radar  Establishment 
Graat  Malvern,  Worcoetershire,  UK 


SUMMARY 


Thia  paper  daicribaa  a  aimilation  tool  of  sufficient  flexibility  to  net  moat  of  the  simulation  require¬ 
ment!  for  a  large  variety  of  ayatema.  Conceptually  SIMBOX  provide!  a  box  into  vhich  a  uaer  can  inaert 
object!  typically  found  in  a  defence  environment,  auch  aa  aircraft,  ehips,  aenaora  and  weapon!,  Theae  can 
be  controlled  by  the  uear  and  the  date  generated  aa  a  reault  of  interaction!  between  object!  (eg  Flota, 
track! ,  maaaagea)  can  be  extracted,  in  real  time  if  required,  Thia  data  cen  ba  logged  for  off-line 
analysis,  analyaed  on-line,  or  paaaed  to  external  procaaaea  or  device!  where  interfacing  to  real  or  aimu- 
latad  ayetam  element!  ia  required.  The  paper  diacuaaea  the  design  principle!  of  SIMBOX,  outline!  ita 
capabilitiaa,  and  givea  aome  example!  of  ita  application. 

1,  INTRODUCTION 


SIMBOX  ia  a  general  purpoae  simulation  ayatam  giving  a  uaer  facilitiea  for  aetting  up  and  controlling  a 
scenario  of  aenaora,  targata,  weapona,  communication  ayatema  and  other  objects  typically  found  in  a  defense 
environment,  and  monitoring  events  aa  in  a  real  system.  Areas  of  application  include 

i  Syatem  element  design  and  testing 

ii  System  integration 

iii  Man/machine  investigation! 

iv  Inter-system  interoperability  testing 

v  Operator  training 

vi  Performance  ateaiament 

vii  War  games 

SIMBOX  ie  not  a  aimulator  in  the  senae  that  it  limulatae  any  apacific  ayatam  or  anawara  any  specific 
question  by  itself.  Rather  it  ie  t  kit  of  parte  which  allowa  a  uasr  to  build  a  aimulator  to  auit  hie  own 
raquiremente.  To  do  thia  the  uaer  must  supply  an  interface  program  containing  uaer  calls  which  tell  SIMBOX 
what  to  create,  what  date  to  output,  and  how  to  control  evanta. 

The  SIMBOX  anivronment  ia  built  up  from  "objects"  such  as  aircraft,  ships,  eaneora  and  communications 
devices,  which  are  created  in  a  simulation  box  (normally  of  dimannions  1000  Km  x  1000  km  x  100  km),  in 
reaponse  to  uaer  calls,  Theee  object!  interact,  producing  data  streams  appropriate  to  the  nature  of  the 
interaction  and  the  state  (as  a  function  of  tima)  of  the  object*  and  thtir  surrounding  environment.  For 
example,  a  radar  may  interact  with  an  aircraft,  to  produce  a  stream  of  data  consisting  of  radar  plot 
details,  taking  into  account  the  state  of  the  radar  (power,  beam  ahaps  etc),  the  state  of  the  aircraft 
(echoing  area,  velocity  etc)  and  other  relevant  detail*  such  ss  atmospheric  attenuation,  terrain  screening 
and  the  affect  of  jammrs.  Similarly  a  communication  receiver  can  generate  a  data  stream  consisting  of  a 
sequence  of  receiver  messages,  and  so  on. 

The  SIMBOX  uaer  can  request  output  of  these  data  streams,  ia  he  can  obtain  a  copy  at  tha  uasr  interface  of 
data  pertaining  to  aignificant  event!  occurring  inside  SIMBOX.  Additionally,  output  can  be  directed  to 
backing  store  for  data-logging  purposes, 

Similarly,  the  user  can  make  calls  requesting  output  of  data  such  as  tha  current  spatial  co-ordinates  of  sn 
object,  or  its  real-time  state,  Other  calls  allow  him  to  control  SIMBOX  operation,  by  steering  or  launch¬ 
ing  objects,  or  changing  their  perimeters,  and  to  schedule  user  procedures  in  which  user  calls  can  ba 
placed,  and  output  data  processad. 

At  a  higher  level,  the  user  cen  ask  SIMBOX  to  integrutc  simulated  senior  outputs  into  a  common  database,  so 
simulating  *  date  handling  system.  Further,  theee  data  handling  syitami  can  be  drawn  into  a  data  communi¬ 
cations  net,  with  modelling  of  net  protocols  end  opsrator  actions.  Activity  at  various  interfaces  of  these 
high  level  etructures  can  be  monitored. 

SIMBOX  ie  specifically  designed  to  allow  simulation  of  cotqplex  systems  in  real-time.  It  ie  written  in 
CORAL  66,  end  implemented  on  a  DEC  system  10  machine. 


2.  DESIGN  PRINCIPLES 


The  fundamental  principles  around  which  SIMBOX  ie  designed  may  ba  summarised  ee  followsi 


1.  Feet  run  time 


2. 


Ease  of  modification 
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3.  Simple  user  Interlace 

4.  Appropriate  accuracy 

5.  Procaaalng  optima 


Each  o£  then  will  be  considered  in  turn. 

2.1  Faat  Run  Tima 

In  many  applications,  wharc  SIMBOX  is  interfaced  to  real  hardware  or  man/machine  interfaces,  it  will  be 
essential  far  it  to  run  in  teal  tins.  Very  faat  processing  is  required  if  complex  systems  and  large 
acanarioa  are  to  be  modelled.  A  first  requirement  is  of  course  an  efficient  high  level  language  and  for 
this  CORAL  66  was  chosen.  Secondly,  data  structures  must  be  carefully  designed  so  at  to  minimise  the 
overheads  associated  with  accessing  and  updating  data.  SIMBOX  uses  packets  exclusively  for  tha  building 
of  data  structures  and  for  passing  information  to  the  user  or  between  procedures.  Theae  packets  are  linked 
into  chains,  giving  very  fast  access  end  largely  eliminating  the  naad  for  run  time  searching  of  data 
entries.  The  structures  also  allow  dynamic  storage  allocation,  with  no  problems  associated  with  garbage 
collection. 

Finally  care  mutt  be  taken  to  prevent  unnecessary  processing.  An  example  of  this  in  SIMBOX  is  the  uae  of 
"lifetimes"  in  association  with  soma  complex  calculations,  where  a  calculation  is  inhibited  if  the  result 
of  a  previous  calculation  of  the  same  type  is  Btill  valid  in  practical  terms. 

2.2  Ease  of  Modification 

SIMBOX  it  .designed* £0  allow  simple  modification  and  enhancement,  for  example  the  introduction  of  new  object 
types,  to  meet  the  requirements  of  future  systems.  This  is  largely  engineered  by  a  very  extensive  use  of 
Macros,  some  1000  of  which  are  currently  defined, 

2.3  Simple  User  Interface 

A  user  comnunl cates  with  SIMBOX  vis  a  "user  prcgrAm"  ie  a  set  of  procedures  containing  high  laval  user 
calls.  Facilities  provided  by  the  latter  include 

i  Objec't  creation  and  deletion 

ii  Steering  control 

ill  Real  time  parameter  control 

iv  Data  I/o  requests 

vi  User  program  scheduling 

vii  Data  logging 

viii  Trace  and  debug  options 

ix  Packet  handling  facilities 

x  Utilities  such  as  file  handling  and  data  print-out  routines 

Some  of  these  facilities  are  further  described  bolow.  In  all  cases  the  user  calls  are  very  flexible  allow¬ 
ing  a  wide  range  of  users  to  be  catered  for.  These  may  range  from  those  who  are  content  to  use  SIMBOX  on 
a  black  box  bails,  with  perhaps  scant  knowledge  of  programming  techniques,  to  those  who  wish  to  control 
every  nuance  of  operation.  It  is  possible  to  get  hands-on  experience  very  quickly  and  with  little  effort, 
This  is  very  important  if  potential  users  are  not  to  be  frightened  off  by  the  inevitably  long  user  guide. 

In  all  but  the  simplest  of  situations  the  output  of  a  system  simulation  will  rarely  be  whet  the  user 
expected,  and  the  tool  will  always  be  suspected.  Thus  analysis  aids  are  provided,  with  data  print-out 
facilities  designed  to  build  up  the  users  confidence  in  the  model.  Alio  ieportant  is  the  need  to  protect 
the  user  from  his  own  errors.  Extensive  error  detection  and  reporting  mechanisms  are  provided,  together 
with  trace  and  debug  facilities, 

2.4  Appropriate  Accuracy 

It  Is  considered  adequate  that  tha  accuracy  of  the  data  produced  by  SIMBOX  is  typical  of  that  which  would 
be  produced  by  a  real  system.  Far  example  the  quantum  of  range  measurement  it  1  metre.  Tills  allows  the 
use  of  Integer  data  represention  with  a  consequential  increase  in  processing  speed, 

2.5  Processing  Options 

Various  options  are  available  to  allow  tailoring  of  SIMBOX  processing  and  the  depth  of  simulation  to  suit 
the  task  In  hand.  If  for  example  SIMBOX  is  being  used  to  assess  the  performance  of  s  radar,  say  in  terma 
of  probability  of  detection  of  a  target  as  a  function  of  target  range,  then  sophisticated  simulation  of  the 
radar  may  be  requested.  On  the  other  hand,  If  plots  are  being  generated  for  output  to  a  display  tn  teat 
operator  functions  then  a  very  simple  radar  model  may  suffice,  and  SIMBOX  can  be  instructed  to  evoid 
unnecessary  processing. 


3. 


0BJ2CT  CREATION 


An  object  in  SIMBOX  ie  described  primarily  by  an  object  code,  containing  various  fields  such  as  type 
(aircraft,  ship,  radar  etc),  subtype  (submarine,  tanker  otc.  for  ships),  role,  national  identity  and  so 
forth.  An  object  is  further  described  by  a  set  of  real  time  parameters.  In  the  case  of  a  radar  for 
example  these  will  include  the  current  prf,  aerial  pointing  angle  and  so  on,  keel  time  parameter  values 
may  vary  with  time  an  a  SIMBOX  run  progresses,  either  in  response  to  user  requests  or  as  e  result  of 
SIMBOX  internal  activities. 

SIMBOX  contains  a  library  of  objects  incorporating  object  codes  and  reel  time  parameters  and  a  user  can 
describe  an  object  in  a  creation  request  simply  by  supplying  ths  library  name,  At  the  other  extreme  the 
user  can  specify  an  object  cosq>lately  by  supplying  a  full  set  of  object  code  field  and  real  time  parameter 
values.  In  between  theta  extremes  various  mixes  of  utar  supplied  and  library  supplied  values  can  he 
requested,  New  object  description!  can  be  added  to  the  library,  and  hanceforth  called  by  uae  of  a  library 
name. 

Groups  of  objects  are  generally  linkad  in  trsaa  which  denote  e  "carrying",  "carried  by"  relationship.  An 
example  of  a  tree  structure  is  shown  in  Fig  1.  In  fact  the  tra*  is  the  basic  unit  of  construction  for  a 
user;  a  single  object  it  e  trss  containing  on*  object  only.  A  tree  can  b*  cf  any  complexity  and  thsrs  is 
no  logical  limit  to  ths  number  of  trass  which  can  bs  created.  When  SIMBOX  is  asktd  to  crest*  a  tree  it 
must  be  presented  with  information  describing  ths  objects  in  the  trss  (most  simply  ths  library  names)  end 
the  tree  structure.  Inside  SIMBOX  the  tree  structure  ie  morrored  by  cross  links  established  between  the 
data  structures  describing  the  individual  object*.  Datasets  describing  abject  trees  sre  held  in  diec-beeed 
file*  celled  "scenario  files".  In  sffect  these  are  tree  libraries,  and  a  ussr  can  call  for  tha  craation 
of  ona  or  more  treas  simply  by  giving  SIMBOX  a  rtcord  numbs r  and/or  filtname,  Facilities  era  provided  for 
interactive  inspection  and  modification  of  the  libraries. 

A.  STEERING 

abject  trees  are  steered  through  tha  simulation  space  according  to  instructions  held  in  "steering  packets" 
which  may  be  generated  at  any  time  and  attachsd  to  a  chain  held  by  the  traa.  Conceptually  there  era  two 
types  of  steering  packet.  In  the  firet,  the  packet  describes  e  simple  manoeuvre  and  the  duration  of  the 
manoeuvre,  either  directly  or  by  specifying  a  terminating  condition.  For  example,  tha  description  might 
msan  "continue  existing  cliob  rats  and  execute  a  lg  turn  clockwise  until  heeding  is  greeter  than  70 
degrees".  On  completion  of  the  manoeuvre  tha  next  packet  on  the  steering  chain  will  be  picked  up  end 
obeyed  if  there  is  one)  otherwise  the  object  will  maintain  constant  velocity  until  such  time  as  a  furthar 
steering  packet  it  supplied.  In  the  second  type  the  picket  describee  a  continuous  pattern,  euch  **  a 
racetrack  or  a  aequancc  of  random  turns,  which  the  steered  object  will  follow  until  a  new  steering  packet 
is  supplied. 

A  wide  rang*  of  options  is  available  to  the  user  as  to  how  ha  exarciaes  stearing  control.  He  can  fill  out 
and  plant  ataaring  packet!  hiasalf  at  ona  axtrame.  or  at  the  other  he  can  enter  interactive  dialogue  to 
request  SIMBOX  to  handle  the  details  for  him.  Steering  information  can  elao  be  incorporated  in  acanerio 
file  descriptions. 

5.  OBJECT  CO-LINKING 

As  naw  objacta  are  crested,  SIMBOX  automatically  generates  links  between  tha  new  data  structures  and  thosa 
corresponding  to  previously  crested  objects  as  required.  In  particular,  "interest  chains"  are  established 
for  each  object,  to  define  a  limited  environment  of  interest  to  that  object.  For  exaapla,  ships,  aircraft, 
and  jatmwira  on  tha  appropriate  frequency  band  will  be  of  interest  to  s  radar,  while  sonars  will  not  be  of 
interest.  In  fart  there  are  tvo  typew  of  chain,  interest  chains  which  define  the  environment  of  current 
Intersit  (eg  for  u  rsdar,  targets  hiving  a  significant  probability  of  defection  and  in  line  of  sight)  and 
possible  interest  chains  which  define  other  objects  which  may  in  time  become  of  current  interest.  These 
chains  form  the  basis  of  scheduling  sctivLty  inside  SIMBOX  and  are  a  powerful  mechanism  in  preventing 
unnecessary  proce oiling.  Co-linking  and  the  associated  scheduling  of  processing  activity  takes  place  only 
as  required.  If  lor  'example  a  tree  li  created  constating  of  a  ship  carrying  an  aircraft  which  in  turn 
Carrie*  a  cedar,  then  co- linking  oi  the  radar  environment  and  calle  for  tha  radar  eimulator  will  not 
normally  be  mad*  until  the  aircrait  la  launched  from  the  ehip.  User  options  ere  available  to  allow  control 
over  the  co-linking  mechanism  if  required. 

6.  OBJECT  NAMES 

SIMBOX  generate*  a  unique  name  for  aach  object  which  it  creates,  This  is  returned  to  the  user  either 
directly  or  via  various  search  routine*  which  are  available  to  the  user.  The  name  la  uaed  aubsequently  in 
uaer  calls  which  request  soma  operation  on  an  object,  say  a  request  for  output,  or  the  planting  of  ataaring 
information.  Also,  a  user  can  attach  his  own  names  to  objects,  Ha  may  wish  for  example  to  attach  a  common 
name  to  all  members  of  a  group  of  objects,  buy  *11  objects  launched  at  various  times  from  t  common  carrier. 
Or  he  msy  wish  to  teg  an  object  inside  SJ.18S0X  with  the  identification  of  an  external  element,  say  an 
axtamai  track  number,  or  the  code  number  of  the  operator  responsible  for  eteering  the  object.  A  user  nine 
may  ba  supplied  in  two  ways.  In  tha  firnt  tha  name  is  associated  directly  with  e  specified  object.  In  the 
second  the  name  is  applied  to  the  view  of  one  object  as  seen  by  another  object!  eg  for  a  radar/target  pair, 
the  nsme  will  be  associated  with  the  r  !  vr  plot  or  trick  list  entry  associated  with  the  target,  rather  then 
tho  target  itself, 

7.  J/ATA  OUTI’IIT 

Output  of  information  from  SIMBOX  can  be  organised  in  various  ways,  including! 

(*)  Single  shot  ot  tput  of  date  such  ss  dins  or  object  spatial  co-ordinate*. 


(b)  Repetitive  output  at  uaer  selected  intervale  of  data  such  as  object 
co-ordinates  or  real  time  parameter  values. 

(c)  Output  at  the  time  of  significant  events,  Buch  bb  the  output  of  a 
radar  track  list  entry  whenever  tha  entry  ia  updated. 

Data  can  be  output  directly  to  tha  user  program,  directly  to  peripheral  devices,  or  both.  If  output  to 
the  user  program,  the  data  ia  packed  into  packets  which  are  linked  onto  uaer  data  chains,  in  time  order. 
Separata  chains  are  maintained  for  each  object  for  which  output  has  been  requested,  with  access  vie  the 
object  nan*.  If  output  ia  to  peripheral*,  tha  data  is  annotated  according  to  a  user  specified  verbosity, 
and  written  directly  to  a  user  specified  file. 

In  all  cases,  output  ia  controlled  by  a  simple  user  call  specifying  the  nrftura  and  format  of  tha  output 
required.  There  is  no  logical  limit  to  tha  number  of  parallel  output  data  stream*  Which  can  bt  obtained 
frost  the  various  object  interfaces, 

A  user  may  also  wish  to  orgsniss  .output  from  his  own  user  program,  A  sat  of  high  level  call*  are  provided 
for  this  purpose  to  relieve  tha  user  of  the  need  to  know  the  details  of  I/O  channel  utilisation. 

a.  COMMUNICATION  NETS 

S1MB0X  currently  can  model  a  Link  11  data  net.  Other  data  nete  are  to  be  Incorporated. 

If  an  object  ha*  object  type  aircraft,  ahip,  airfield,  port,  land  vehicle,  land  weapon  site  or  land  op 
centra  it  can  become  n  Link  11  PU,  providing  that  it  carries  a  Link  11  recuivar  and  transmitter.  A  user 
call  LINK  11  INITIALISE  ia  used  to  draw  objects  into  a  net, 

Thil  names  the  objects  vhioh  are  to  bacons  PUs,  allocate* 
track  number  blocks,  PU  nusfcers  and  cooinand  responsibilities,  defines  net  operating  details  such  as  baud 
rats,  and  spacifiea  tha  polling  sequence. 

A  PU  thus  formed  is  allocated  an  "integrated  data  baaa",  into  which  data  received  from  its  own  Link  11 
receiver  and  data  received  from  its  cwn  sensors  era  intagrated.  Actual  massage  transmission  start*  after 

tha  user  has  made  a  second  cell,  LINK  11  START,  The  PU  nominated  a*  net  controller  than  polls  the  net  in 

accordance  with  tha  previously  given  polling  aaquanca.  Polled  PUs  transmit  massage  streams  appropriate  to 
the  contents  of  their  integrated  data  basts.  Manage  content,  transmission  frequencies,  allocation  of 
reporting  responsibility  etc  fallow  the  Link  11  rules  ai  defined  in  the  STANAG  end  SOPs. 

Massage  transmission  is  simulated  in  terms  of  tits*  delays  and  garbling  du*  to  propagation  offset*  or 
jamming.  Whether  or  nut  any  message  (including  control  massages  such  as  picket  atop)  transmitted  by  a  PU 
actually  arrives  at  tha  receiver  of  another  PU  depends  on  tha  state  of  affairs  at  tha  tine  of  maasagu 
transmission,  taking  into  account  tha  transmission  rungs,  tha  current  transmitter  power,  tha  jamming 
■ituation  etc. 

As  pert  of  tha  description  of  tha  Link  11  recaivara  and  transmitters  (real  time  parameters)  provided  at  the 
time  these  objects  are  created  the  user  supplies  (or  calls  from  tht  library)  a  description  of  the  Link  11 
implementation  in  tarms  of  the  recognised  message  catalogue,  tha  implemented  fields  of  each  massage  and  the 

interpretation  to  ba  placed  on  field  values.  He  can  also  supply  details  of  filters  fur  application  to  the 

receiver  and  transmittar  massagt  streams.  Thasa  details  can  bo  different  for  each  PU. 

The  user  can  obtain  copies  of  messages  appearing  at  various  point*  in  the  system,  using  the  output  facill- 
tias  mentioned  previously.  Calls  are  also  available  to  allow  inspection  or  modification  of  th*  integrated 
data  bases. 

A  user  may  wish  to  interface  to  an  external  data  handling  system,  or  to  a  simulation  of  such  a  system  held 
in  hit  own  program.  In  this  case  h*  can  create  a  PU  inside  SIMBOX  but  inhibit  the  infernal  data  base 
Integration  for  that  PU.  Uear  calls  are  available  which  then  allow  him  to  interface  tu  the  external  system, 
while  SIMBOX  still  simulatas  tha  rest  of  the  net, 

9 .  THE  USER  PROGRAM  -  AN  EXAMPLE 

An  example  of  a  typical  uaer  program  ia  given  in  the  appendix.  The  example  choaan  ia  one  of  radar  tracking 
assessment,  tha  program  printing  out  th*  probability  of  tracking  a  target  by  an  airborne  system  as  a 
function  of  target  range.  Tha  procedure  USER  SETUP  it  called  by  SIMBOX  at  clock  time  srro  to  allow  tha 
user  to  tat  up  the  initial  scenario  and  I/O  requests,  and  to  schedule  any  othar  user  procedures.  In  this 
example  a  uaer  procedure  it  scheduled  to  be  called  at  Intervals  corresponding  to  tha  rotation  pariod  of  tha 
radar  aerial  to  allow  a  count  of  the  nuefcer  of  radar  track  l^at  entries  updated  in  the  preceeding  scan. 

The  example  is  given  primarily  to  illustrate  tha  typically  small  aisa  of  a  user  program  in  relation  to  tha 
ovarall  simulation  task.  In  deriving  the  output  data  SIMBOX  will  take  into  account  factors  such  at  aarial 
betmshnpe  and  other  parumeters  of  the  radar,  the  engagamant  geometry,  th*  effect  of  a  curved  earth,  atmos¬ 
pheric  attenuation  and  diffraction,  target  echoing  area  fluctuation,  and  the  parameters  of  th*  tracking 
algorithm, 

10.  APPLICATIONS 

Figs  2  to  4  illustrate  varluus  applications  of  SIMBOX. 

In  Fig  2,  u  radar  performance  is  being  assessed,  The  user  program  makes  user  calls  requesting  scenario 
creation  and  radar  track  output,  which  is  analysed  in  the  uaer  program.  This  class  of  application  is 
exemplified  by  the  program  shown  in  th'  appendix.  The  renge  of  applications  like  this  is  vltcually 
unlimited;  examples  are  data  link  loading  studies,  investigation  of  track  correlation  problems,  the  offsets 
of  jaeseing  and  s<  rn. 


Fig  3  show*  SIMBOX  interfaced  to  a  teal  aystan  element;  in  thia  example  a  tracking  algorithm  aoftware 
package  ie  being  tested,  The  ueer  program  secs  up  a  radar  and  target  scenario  and  requestt  plot  output 
irom  the  radar  and  navigation  output  from  the  targets.  The  latter  (actual  target  position)  can  be  ccr- 
nared  with  the  tracker  derived  position  to  assess  tracker  performance. 

Fig  4  shows  SIMBOX  interfaced  to  a  data  handling  system.  SIMBOX  simulates  the  entire  environment  which 
would  be  teen  looking  out  from  the  data  handling  system  interface;  la  own  sensors  and  carrier,  other  net 
participants  with  thair  sensors  targata,  jammers  etc.  Data  from  the  simulated  own  tensor*  (including 
received  communication  messages)  is  ptsssd  from  SXKBOX  to  tho  data  handling  systam.  In  tha  ravaraa 
diraction  go  cosmunicrtion  messages  from  tha  DHS  and  sensor  controls  resulting  from  operator  actions. 

SIMBOX  can  ba  similarly  connected  to  a  number  of  real  systema  to  provide  a  test  bad  for  studying  inter¬ 
operability  problems. 

11.  CONCLUSION 

SIMBOX  has  proved  en  effective  tool  in  support  of  s  major  system  development  project.  It  has  bean  used 
extensively  for  display  simulation,  radar  assessment  and  the  study  of  various  aspects  of  tracking,  corre¬ 
lation  and  data  link  operation. 

In  a  typical  user  application  SIMBOX  may  load  up  to  1CUC  of  program  (36  bit  words)  together  with  ^liiOK  of 
data.  Obviously  there  are  problems  in  gaining  user  acceptance  of  a  program  as  large  and  complex  'as  this, 
and  in  fact  a  substantial  proportion  of  tha  software  is  devoted  lo  tha  task  of  easing  thssa  problems  by 
supplying  comprehaneive  analysis  and  diagnostic  aids.  In  practice,  user  acceptance  has  bean  good. 

It  it  difficult  to  give  performance  figures  without  being  epecific  about  the  nature  of  the  scenario  and 
the  application.  As  a  guide  however  in  tn  application  such  as  that  shown  in  Fig  4  a  peak  scenario  of  800 
targets  can  be  handled  in  real  time,  with  a  typical  mix  of  aircraft  carrying  jammers,  aircraft  carrying 
IFF  equipumnt,  and  so  on.  This  figure  relates  to  a  KT.10  processor,  At  least  twice  the  performance  can  be 
ejected  from  that  more  modern  KLlO  processor* 

It  is  envisaged  that  SIMBOX  will  form  the  basis  of  many  test  rigs  and  training  simulators  in  a  variety  of 
systems;  the  advantage*  to  be  gained  in  terms  of  compatibility,  atandardiaation  and  resource  sharing  are 
obvious. 
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APPENDIX.KXAMPLE  USER  FROQRAM. 


'CORAL' 

'  PROGRAM' SIMBOXi 
'  LIBRARY'  ("SYS  I  USECOK,  CRL" )  J 
'  SEGMENT' EX6{ 

'BEGIN' 


' INTEGER' RADAR  NAME, NAME, AC  NAME; 


'PROCEDURE' USER  SETUP, 

- ) 

'BEGIN' 

' COtMENT* CREATE  AEW  SYSTEM  (TREE  NO  4  OR  AEWS  SCENARIO  FILE. 

THIS  .IAS  STANDARD  PATROL  RACETRACK  PATTERN)  j 
AC  NAME t ■INPUT  TREE ("AEWS. LIB" ,4, OFF) [ (DIALOGUE  SWITCHED  OFF) 
'COMMENT' SEARCH  FOR  THE  NAME  OF  THE  RADAR  IN  THIS  NEW  TREE 
AND  REQUEST  OUTPUT  FROM  IT  (I/O  CODE  B-TRACK  UPDATE  DATA) » 

PORTREE  OBJECTS  (AC  NAME,  AIRCRAFT  .RADAR,  AEW, NAME) '  DO' 

'BEGIN' 

RADAR  NAME  I -NAME  j 

REQUEST  OUTPUT(RADAR  NAME, RADAR, RTIO, 8,0, ON) 

'END') 

'COMMENT' INPUT  SCENARIO  FILE  CONTAINING  100  TARGETS, DIALOGUE 
SWITCHED  ON  TO  ALLOW  INTERACTIVE  SETTING  OF  VELOCITY .HEADING  ETC{ 
INPUT  SCENARI0("RA1D.LIB",0N); 

'COMMENT' AEW  RADAR  WILL  HAVE  10  SECS  AERIAL  ROTATION  PERIOD. 

ARRANGE  FOR  USER  PROG  1  TO  PICK  UP  THE  REQUESTED  RADAR  OUTPUT 
ONCE  PER  SCAN) 

SCHEDULE ( 1 , 10000,10000) } 

'END'  | 

'PROCEDURE 'USER  PROClj 

(  m.«.n..n.n«ina>un) 

'BEGIN' 

'COMMENT' COLLECT  REQUESTED  OUTPUT  DATA  FROM  RADAR'S  USER  DATA  CHAIN. 
COUNT  OF  NUMBER  OF  PACKETS  WILL  GIVE  NUMBER  OF  TRACKS  IN  TRACK  LIST* 
'INTEGERS, Pi 
Nl-OI 

' FOR' P  t "TAKE  10  PACKET(RADAR  NAME, 0) 'WHILE  'P'NE'O'DO' 

'BEGIN' 

Ni-N+lj 

RELEASE  PACKET(P) 

'END'  i 
NL| 

TYPE  ("REV  NUMBER  ")  ;  TYPE0UT(CL0OCTIME/l0000)  ( 

TYPE("  NO  OF  I  RCrrS  IN  TRK  LIST-")  iTYPEOVT(N)  i 

'END'  J 


'END' 

’FINISH’ 
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THE  APPLICATION  OF  MODELING  AND  SIMULATION  TO  THE  DEVELOPMENT  OF  THE  E-3A 
l  A.R,  Shanuhun 

The  MITRE  Corporation 
Bedford,  Massachusetts  01730 

SUMMARY 

The  E-3A  Airborne  Warning  and  Control  System  (AW ACS)  is  a  newly  developed  and  sophisticated  alrbonit^.lar,  communications,  and 
command-and-control  system.  It  has  been  designed  to  perform  a  function  never  before  possible:  all-uitittuu  .urveillunce  of  large  vol¬ 
umes  of  airspace  in  the  presence  of  severe  ground  clutter  which  results  from  operation  over  land.  The  development  of  this  advanced 
technology  system  has  been  difficult  but  successful.  Modeling  and  simulation  have  played  an  important  role  hi  this  success. 

Modeling  and  simulation  served  a  variety  of  functions  throughout  E-3A  development.  They  assisted  in  designing  key  subsystems  such  us 
the  radar,  integrating  the  overall  system,  developing  the  operational  computer  software,  predicting  system  performance,  projecting  mis¬ 
sion  effectiveness,  and  advocating  the  system  and  Its  capabilities.  Rather  jhan  describe  any  one  of  the  many  E-3A  simulation  models  in 
depth,  this  paper  focuses  on  the  modeling  diversity  required  to  satisfy  various  E-3A  program  needs  during  different  stuges  of  system 
development,  Thumbnail  sketches  of  several  representative  models  arc  included.  This  ease  history  reveals  that  models  and  simulations 
were  necessary  and  important  tools  In  the  development  of  the  E-3A.  Their  contributions  were  both  substantial  and  widespread.  Several 
valuable  lessons  were  learned  In  the  process. 

1.  INTRODUCTION 

1.1  Overview 

Modeling  and  simulation  liuvc  been  applied  liberally  throughout  the  E-3A  program,  Even  before  there  was  an  E-3A  program,  they  wore 
used  extensively  to  establish  the  system's  theoretical  feasibility  and  to  bound  its  performance  requirements.  In  the  early  days  of  system 
development,  simulation  uldcd  in  the  actual  subsystem  design,  most  notably  of  the  rudur  subsystem,  Later  It  was  applied  to  the  problem 
of  determining  the  appropriateness  of  vurlous  hardware  und  software  designs  over  a  range  of  operational  situations,  The  design  of  an 
effective  target  tracker  wus  one  of  the  morn  noteworth'  development  hurdles  during  this  period,  Accurate  rudar  performance  prediction 
then  became  the  critical  concern,  und  u  family  of  mod  were  developed  to  perform  this  function.  These  models  were  developed  in  an 
Iterative  fashion  as  system  flight  lest  dutu  became  available  over  time, 

Modeling  and  simulation  wore  extremely  valuable  in  the  early-  to  mid-seventies  for  addressing  the  system-advocacy  issues  of  (he  times, 
issues  that  could  not  be  addressed  by  night  test  until  yours  later.  In  one  Instance  an  "obvious  fact"  was  shown  by  simulation  to  bo  a 
falsehood. 

A  representative  sampling  of  the  muny  uses  to  which  simulation  lias  been  applied  und  the  contributions  It  has  made  to  E-3A  system 
development  is  presented  in  Section  In  general,  all  of  the  models  and  simulations  used  on  the  E-3A  program  huve  been  deterministic 
or  Monte  Carlo  mathematical  formulations  written  in  the  FORTRAN  programming  lunguuge  for  vurlous  high-speed  computer.!.  Tln-lr 
slr.es  have  ranged  from  u  few  lines  of  code  to  sovcrul  thousand,  As  an  uxumplo  of  a  current  application  of  simulation  thut  benefits  the 
operational  E-3A  fleet  toduy,  a  brief  description  of  the  H-3A  Mission  Simulator  is  also  provided, 

Several  valuable  lessons  concerning  modeling  und  simulation  have  been  learned  over  Hie  course  of  E-3A  development.  These  lessons 
highlight  cortuln  important  truths  ubout  modeling  thut  must  be  understood  und  accounted  for  when  developing  any  uvlonics  or  C3 
system.  These  truths  urc  discussed  in  Section  3. 

1.2  E-3A  Program  Sunmiury 

The  E-3A  is  the  result  of  utmost  fifteen  ycurs  of  concerted  el  fort.  In  the  mid-1960s  the  Overland  £udiu  Technology  Program  was  estab¬ 
lished  by  the  United  States  Air  Force  to  determine  the  feasibility  of  overbad  rudur  techniques  for  long-range  surveillance  of  low-flying 
aircraft,  As  u  result  of  this  feasibility  program,  which  succeeded  In  Identifying  two  promising,  pulso-doppler  rudur  techniques,  one  by 
Westlnghouse  und  one  by  Hughes,  the  Air  Force  prepared  a  Concept  Formulation  Puckugc  for  the  E-3A  Airborne  Warning  und  Control 
System  (AWAC'S)  program,  This  package  wus  approved  by  the  Department  of  Defense  In  late  1967,  The  Contract  Definition  Fliuse  was 
authorised  In  1968  with  the  stipulation  that  a  full-scale  radar  demonstration  be  given  before  full  program  approval.  The  Boeing  Com¬ 
pany  was  awarded  the  prime  contract  in  July  1970,  The  contract  was  divided  into  three  phases:  Brussbourd,  full-scale  development,  and 
production. 

The  purpose  of  the  Brussbourd  phase  was  to  demonstrate  that  an  airborne  rudar  could  have  an  operationally  useful  ovcr'und  surveillance 
uupubtllty.  From  March  through  August  1972  a  competitive  fly-off  wus  conducted  between  the  two  pulso-doppler  radars  under  con¬ 
sideration,  und  In  the  fall  of  that  ycur  Westlnghouse  wus  selected  as  the  E-3A  radar  contractor.  An  airborne  trucking  demonstration  was 
then  conducted  with  the  winning  radar  in  late  1972.  This  wus  followed  by  several  additional  demonstrations  In  the  United  Stutcs, 
culminating  In  the  first  E-3A  demonstration  In  Europe  in  April  1973, 

The  first  segment  of  the  full-scale  development  phase,  the  System  Integration  Demonstration  (SID),  was  successfully  completed  in 
September  197'),  The  Bruasboard  aircraft  and  radar  were  retained  and  production  prototypes  of  most  of  the  other  E-3A  mission  avionics 
equipments  were  added.  Tills  formed  u  single-thread  system  to  demonstrate  the  basic  functional  capabilities  und  to  show  that,  the  various 
mission  uvlonics  elements  could  be  Integrated  into  a  smoothly  working  system.  Following  a  series  of  special  tests  In  the  United  States, 
the  SID  E-3A  was  deployed  to  Europe  for  a  demonstration  to  senior  NATO  defense  officials  und  military  personnel  In  April  1 975. 
Successful  completion  of  the  SID  test  program  demonstrated  thut  the  principal  high-risk  factors  trad  been  resolved  and  production 
authorization  was  recicvcd. 

The  remainder  of  the  development  program  deult  with  the  system  testing  and  qualification  of  the  production  configuration  which  wus 
developed  in  1975-1976.  Three  test  aircraft  for  this  phase  underwent  rigorous  testing  in  1976-1977  with  participation  by  Air  Force  und 
contractor  personnel.  The  first  production  aircraft  wus  delivered  to  the  USAF  Tactical  Air  Command  at  AW  AC  Wing  Headquarters, 
Tinker  AFB,  Okluliomu,  on  24Murcli  1977,  As  of  September  1979.  nineteen  of  the  total  programmed  force  of  34  E-3As  huve  been 
delivered. 
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The  production  E-3A  system  avionics  (figure  I)  include  a  surveillance  radar  and  IFF  processor;  navigation  equipment;  a  high  speed  data 
processor;  nine  multipurpose  and  two  specialized  display  consoles;  and  a  variety  of  UHF,  VHF,  and  HF  communications  equipments. 

The  airframe  is  a  modified  Boeing  707-320B.  With  a  mission  crew  of  thirteen,  the  12-3  A  is  designed  to  provide  timely  detection,  tracking, 
and  identification  of  uircruft  within  its  surveillance  volume,  data  communication  of  this  information  to  external  elements,  and  military 
command  and  operational  control  of  friendly  aircraft. 

An  E-3 A  enhancement  program  was  established  in  1 974  to  augment  tho  E-3 A's  already  substantial  capabilities.  The  currently  approved 
program  consists  of  the  incorporation  of  a  Joint  Tactical  Information  Distribution  System  (JT1DS)  capability  for  high-capacity,  jam- 
resistant  digital  communications,  a  maritime-surveillance  capability  for  detecting  and  tracking  ships,  an  expanded  capability  Involving 
the  addition  of  several  radios  and  central-processor  capacity,  and  other  minor  ayatem  enhancements  and  product  Improvements, 


NATO  is  procuring  eighteen  enhanced  E-3A  systems  as  part  of  Its  advanced  Airborne  Early  Warning  force.  Delivery  of  the  first  NATO 
E-3  A  Is  scheduled  for  early  1982,  with  subsequent  deliveries  over  the  following  three  years. 

2.  APPLICATIONS  OF  MODELING  AND  SIMULATION  DURING  E-3A  DEVELOPMENT 


2.1  Detailed  Subsystem  Design 

The  heart  of  the  E-3A  system  and  its  greatest  technological  achievement  is  its  surveillance  radar,  which  must  pick  out  low-flying  aircraft 
from  ground  clutter  over  an  area  of  thousands  of  square  miles,  Key  advances  were  made  in  developing  the  radar  in  the  areas  of  ultra- 
stable  signul  generation  and  dlgttul  processing.  In  addition,  the  narrow-beam  signal  with  its  low  antenna  sldelobe  characteristics  -  which 
arc  necessary  for  accurate  target  detection  overland  -  was  achieved  through  a  significant  advance  in  the  design  of  the  radar  antenna. 
Lastly,  the  low  sldelobe  characteristics  of  the  transmitted  energy  pattern  and,  hence,  the  high  performance  of  the  radar,  were  sustained 
through  the  use  of  a  sophisticated  antenna  shield  or  radomc  designed  to  very  precise  tolerances.  Several  special-purpose  computer  simu¬ 
lations  ussisted  substantially  in  the  process  of  designing  these  major  subsystem  components. 

2.1.1  Rudar  Subsystem  Design 

In  the  design  of  tho  Wcstinghousc  radar,  much  of  tho  general  design  approach  (figure  2)  from  the  receiver  througli  the  signul  processor 
to  the  rudar  duta  correlator  was  defined  in  the  late  sixties  by  design  tradeoff  studies  using  detailed  contractor  simulations.  In  1968 
several  individual  simulations  of  parts  of  the  rudur  were  combined  into  one  end-to-end  simulation  program,  appropriately  called  the 
Long-Form  Radar  Simulation.  By  simulating,  pulse-by-pulse,  the  entire  radar  signul  processing  sequence  from  RF  Input  to  digitized, 
correlated  output,  the  Long-Form  simulation  was  used,  first,  to  explore  the  various  hardware  design  alternatives,  then  to  refine  and 
optimize  the  design  alternative  chosen.  This  design-und-retlne  process  encompassed  both  the  hardware  contlguration  und  the  target 
detection  algorithms  that  would  reside  in  the  rudur  subsystem  software. 

The  Westlngliousc  Long-Form  simulation  was,  us  one  might  expect,  a  very  largo  program.  It  was  programmed  originally  for  the  UN1VAC 
1 108  computer  and  took  100-200  times  longer  to  run  than  the  rudar  takes  to  operate  in  reul  time.  It  has  been  updated  over  the  years, 
converted  to  newer  machines,  und  even  now  Is  used  in  the  continuing  effort  to  extend  und  optimize  tlw  radur’s  capabilities.  Parts  of 
the  program  Ituve  been  borrowed  for  other  uses,  such  us  cost-reducing  design  tradeoff  studies  und  production-unit  performance  evalua¬ 
tion,  replacing  certain  llmc-consumlng  und  costly  acceptance  tests, 

2.1.2  Antenna  Design 

i 

In  the  design  of  the  low-sideloiie  untcmiu,  a  deluded  perlbrmunct  simulation  was  developed  by  Westlnghouso  to  determine  what  the 
antenna’s  electromagnetic  and  mechanical  properties  should  be.  The  antenna  (figure  3)  consists  of  u  planar  array  of  slotted  wuveguides, 
or  "sticks,"  mounted  horizontally  across  the  aperture.  These  sticks  arc  then  manifolded  through  u  series  of  waveguide  coupling  devices 
buck  to  a  common  input  port.  The  dimensions  of  the  sticks,  the  configuration  of  the  array,  und  the  manifold  coupling  design  determine 
the  distribution  of  rudiutod  energy  and,  consequently,  its  muinbeum  and  sldelobe  structure.  The  antenna  simulation  model  was  used  to 
specify  the  optimum  dimensions,  configuration,  und  coupling  design  to  u  very  high  degree  of  accuracy.  It  utilized  propagation  theory, 
circuit  modeling,  und  other  analytical  techniques  to  achieve  the  required  accuracy.  The  inclusion  of  electromagnetic  coupling  effects 
among  the  wuveguides  was  the  largest  single  contributor  to  the  subsequent  agreement  between  predicted  und  measured  pattern  results.  It 
wus  also  lurgely  responsible  for  the  cost-effective  antenna  design  program. 

In  uddltian  to  the  analytical  design  simulation,  u  mechanical  design  simulation  was  developed  to  follow  through  In  the  manufacturing  of 
each  antenna  to  ensure  conformity  with  the  stringent  tolerance  requhements.  liven  ihe  machining  process  was  controlled  by  computer. 

2.1.3  Radomc  Design 

In  the  design  of  flic  radomc,  or  protective  bubble  for  the  antenna  ( figure  4),  a  ray-tracing  computer  model  wus  developed  by  The  Boeing 
Company  to  predict  the  radar  signul  transmission,  reflection,  ubsorptlon,  und  phuse  delay  resulting  from  various  rudome  designs.  Those 
ure  the  principal  fuctors  affecting  the  radur  sldelobe  levels  und.  ultimately,  tile  performance  of  the  entire  rudur  subsystem.  The  design 
parameters  included  In  the  model  consisted  of  rudome  shape,  size,  wall  construction,  untonnu  configuration  and  locution,  operating 
frequency,  und  several  electromagnetic  design  constraints.  Oik-  of  the  most  obvious  Issues  to  resolve  during  this  time  period  wus  whether 
to  mount  the  rudomc/untenna  over  the  fuselage  or  on  the  tall.  Through  the  use  of  the  ruy-trudng  computer  model  (und  extensive  wind 
tunnel  tests)  tin  acceptable  fuselage-mounted  rudome  wus  derived  In  1970  and  subsequently  verified  by  scale-model  radiation  pattern 
measurements. 

This  original  radomc  was  of  uniform  thickness.  Continued  study,  simulation,  und  pattern  measurements  resulted  In  an  improved  version 
In  1972  that  was  tapered  discreetly  in  thickness.  When  In  1975  il  wus  found  that  reskiuul  rudur  shield  e  duller  In  certain  regions  wus 
still  higher  than  desired,  a  rudur  simulation  developed  by  MITRE  the  Air  Force's  System  Engineer  for  the  E-3A  was  used  to  Isolute 
the  cunse,  Meusurcd  radiation  patterns  representing  the  untennu  alone  and  the  antenna  with  rudome  were  separately  fed  into  Ihe  simula¬ 
tion,  and  the  additional  sldclobcs  were  found  to  result  from  specific  ureas  within  the  rudome.  Ultimately,  this  led  to  a  radomc-hiiprove- 
ment  program  which,  when  completed  In  1981,  will  yield  u  90  percent  reduction  in  the  rudur  signul  losses  attributable  to  the  rudome. 
This,  In  turn,  will  result  In  u  significant  increase  in  the  E-3  A  surveillance  capability. 
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Radar  Performance  Prediction 


Especially  during  the  eurly  phases  of  system  acquisition  it  was  important  to  be  able  to  predict  how  well  tile  radar  would  perform.  The 
radar  was  the  largest  single  technical  risk;  look-down  surveillance  over  land  was  never  before  possible.  There  w»i  some  skepticism  that 
this  latest  attempt  would  be  successful.  Yet  performance  prediction  over  a  sufficiently  broad  range  of  operational  situations  was  no  easy 
task  -  in  fact,  without  simulation  it  was  not  possible, 

Two  types  of  simulation  -.vere  requited  to  allow  adequate  performance  prediction.  One  waa  the  detailed  simulation  of  the  phenom¬ 
enology  involved  in  transmitting  large  amounli  of  radio  frequency  radiation  through  the  atmosphere,  onto  the  ground  as  well  as  low- 
flying  aircraft,  and  back  through  the  atmosphere  into  the  receiver,  The  second  type  of  simulation  was  a  higher  level,  shorter  version  of 
the  Long-Form  Radar  Simulation  that  would  permit  extensive  analysis  and  assessment  of  system-level  perfurmsnee  in  larger,  scenario- 
type  simulation  models. 

2.2.1  Phenomenology  Models 

In  the  phenomenology  area,  several  models  were  developed.  One  was  an  atmospheric  refractlvlty  model,  originally  developed  to  study 
propagation  effects  on  surveillance  coverage.  Another  was  a  ground  clutter  prediction  model  for  studying  the  various  types  and  mechan¬ 
isms  of  radar  signal  buckscuttcr.  A  third  was  a  clutter  transient  model  for  studying  the  potential  effects  of  transient  waveforms  at  various 
filters  in  the  receiver.  These  models,  or  key  parts  of  (item,  were  then  incorporated  Into  several  subsequent  models;  most  importantly,  the 
system  contractor's  Surveillance  Function  Simulation  Model,  which  also  utilized  the  second  type,  the  Short-Form  Radar  Simulation. 

2.2.2  Surveillance  Function  Models 

The  Short-Form  simulation  was  designed  by  Wcstlnghouse  to  be  the  functional  equivalent  of  the  detailed  Long-Form  program.  However, 
it  would  run  rapidly  enough  to  provide  scun-by-scnn  rudar  output  data  that  could  be  used  as  direct  input  to  an  E-3A  central  processor 
model  of  extended  system  functions,  such  us  tracking  aircraft  over  many  minutes  of  real  time,  Westlnghouse  used  the  Short-Form  simu¬ 
lation  first  to  optimize  the  operational  radar  parameters  that  would  reside  In  software,  such  as  the  beam  pointing  angki  and  the  angular 
offset  between  the  pulse-dopplor  and  pulse  beams.  Secondly,  approaches  were  explored  for  managing  in  the  software  the  many  different 
•  rudar  modes  that  can  be  selected  for  use  In  different  surveillance  directions  (or  sectors), 

Boeing  used  the  Short-Form  simulation  to  define  and  optimize  the  interface  between  the  radar  and  central  processor  subsystems  and  to 
develop  target  tracking  algorithms  for  use  in  the  eventual  airborne  operational  computer  program.  There  were  minor  feedback  effects 
from  those  system-level  studies  on  the  rudar  hardware  and  software  design,  as  the  overall  performance  of  the  target  trackor  was  iteratively 
brought  up  tu  specification  levels. 

Booing’s  Initial  trucker  choice  during  the  latter  part  of  the  Contract  Definition  Phase  In  1970-197 1  was  culled  a  "pfi"  tracker,  because 
the  principal  stute  variables  used  wore  target  range  (p)  and  azimuth  angle  (0)  relative  to  the  E-3A.  Target  speed  and  heading  relative  to  a 
fixed  reference  direction  (l.e.,  North)  were  also  used.  This  approach  was  used  because  it  allowed  straightforward  integration  of  the  target 
tracking  functions.  Studies  using  the  Surveillance  Function  Simulation,  however,  Indicated  that  tills  approach  led  to  some  fairly  complex 
computational  algorithms.  For  oxamplc,  eight  different  smoothing  coefficients  were  required,  instead  of  the  four  required  in  the  old 
U.S,  Semi-Automatic  Ground  Environment  (SAGE)  system  tracker.  In  addition,  the  ten  unique  elements  of  the  filter  eovaiiance  matrix 
would  have  to  be  updated  ouch  time  the  truck  was  smoothed  or  extrupolatod.  A  Curtesian  ("x,y")  upproach  was  found  to  provide 
superior  performance  while  imposing  less  demanding  computational  requirements,  These  and  other  modeling  studies  resulted  in  an  early 
decision  by  Boeing  to  discard  the  p,0  tracker  In  favor  of  the  x,y  trueke-.  Continued  modeling  studies  over  the  next  few  years  resulted  in 
additional  refinements  to  the  tracker  design. 

2.2.3  Rudur  Performance  Prediction  Models 

Booing's  Surveillance  Function  Simulation  was  needed  for  radar  design  tradeoff  studies  and  operational  software  (o.g.,  tracking)  develop¬ 
ment  and  validation.  At  the  same  time,  the  Air  Force  (through  MITRE)  needed  to  predict  surveillance  pcrfomiance  to  better  assess  the 
system's  potential  contribution  to  Air  Force  operations.  A  variety  of  simulations  which  could  accurately  predict  E-3A  radar  perfor¬ 
mance  In  terms  of  detection  range  ugulnst  various  rudur  cross  section  targets  were  developed,  improved,  and  refined  by  MITRE,  beginning 
with  some  theoretloul  models  in  1968, 

The  first  of  the  E-3A  rudar  perfonnunco  prediction  programs  to  be  developed  wore  a  group  of  Airborne  Moving  Target  Indication  (AMTI) 
progrums  developed  in  Ihe  lute  1 960s.  Their  purpose  was  to  permit  performance  prediction  for  u  variety  of  potential  puhe-doppler  radar 
designs  ugulnst  a  variety  of  aircraft  target  types  and  under  a  variety  of  simulated  operating  conditions.  The  program  design  approach  was 
to  develop  groups  of  subroutines,  or  modules,  tliut  could  be  selected  to  operate  with  any  of  a  group  of  main  programs  (figure  5).  Seven 
main  programs  were  developed  to  provide  Ihe  analyst  with  flexibility  and  selectability  for  assessing  various  radar  design  techniques,  some 
more  sophisticated  than  others. 

The  premise  was  that  If  the  reflected  radar  energy  from  the  target,  the  reflected  energy  from  other  sources  (i.e.,  clutter),  and  the  receiver 
noise  level  were  known,  a  fairly  accurate  prediction  of  the  probability  of  target  detection  under  these  conditions  could  be  made,  The 
factor  with  the  greatest  uncertainty  in  such  a  prediction  was  the  amount  of  clutter  energy  that  would  compete  witli  the  target  return 
signal.  Since  there  was  no  test  radar  then  with  which  to  accumulate  flight  test  data  on  the  expected  clutter  levels  over  various  types  of 
terrain,  the  AMTI  clutter  models  had  to  be  totally  theoretical,  Nevertheless,  performanee  predictions  using  the  AMTI  programs  were 
reliable  enough  to  provide  vuluable  insight  Into  the  general  levels  of  performance  that  could  be  expected  with  various  radar  designs  under 
various  conditions. 

in  1969  portions  of  the  AMTI  programs  were  Incorporated  into  an  E-3A/target  aircraft  trajectory  simulation  program  to  predict  E-3A 
radar  detection  capability  In  various  mission  sccnauos.  The  theoretical  clutter  models  were  still  required  and,  consequently,  the  accuracy 
of  the  simulation  results  was  somewhat  unclear. 

The  radar  performance  und  trajectory  program  was  revamped  In  1 972-1973  when  E-3A  Brassboard  Program  flight  test  data  became 
available.  The  data  was  gathered  und  tabulated  to  provide  target  g..  ..ction  probability  as  a  function  of  targtt  azimuth  off  the  E-3A 
centerline  uxls.  target  velocity,  and  slg,ial-to-noise  ratio  for  flight  over  different  types  of  terrain.  In  essence,  the  effect  of  actual  ground 
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clutter  was  built  into  the  data  and  realistic  and  accurate  performance  prediction  was,  for  the  first  time,  possible.  After  adding  what 
amounted  to  real  clutter  data  on  a  “standard  target,"  which  could  be  scaled  analytically  for  unj  target  at  any  range,  more  improvements 
and  sophistications  were  made  to  the  radar  performance  prediction  program  over  time.  Better  models  for  estimating  atmospheric  losses 
were  incorporated  Into  the  analy  tical  portion  of  the  simulation.  Also,  radar  cross  lection  routines  for  various  Soviet  and  American  air¬ 
craft  were  added  for  estimating  radar  performance  against  specific  aircraft.  Simulation  results  were  found  to  be  quite  cioie  to  the  con 
responding  flight  test  results  that  could  be  obtained, 

The  radar  performance  program  was  again  Improved  and  updated  in  1976-1977  when  development  program  radar  flight  teat  data  became 
available.  Increased  sophistication  wai  incorporated  into  the  program  in  terms  of  radar  modes,  calibration  and  leafing  constants,  system 
losses,  and  minute  beam-spreading  and  refraction  effects  caused  by  the  radome,  This  increased  sophistication  was  made  possible  by  com¬ 
paring  the  simulation  results  with  the  flight  test  data  and  refining  the  simulation  design, 

Even  now  the  radar  performance  program  continues  to  be  improved  and  updated.  The  latest  improvement  has  been  the  incorporation  in 
one  version  of  a  series  of  field  measurements  of  antenna/radome  gain  variation  with  azimuth.  Work  is  also  ongoing  to  refine  the  esti¬ 
mates  of  certain  range-  and  altitude-dependent  system  losses  for  even  more  precise  performance  prediction. 

2.3  System  Advocacy 

A  number  of  criticul  issues  have  arisen  over  the  course  of  E-3A  system  development.  In  addition  to  early  uncertainties  regarding  the 
viability  of  an  effective  overland  surveillance  capability,  there  were  concerns  for  the  survivability  of  such  a  system  in  a  wartime  environ¬ 
ment.  Its  effectiveness,  resistivity  to  jamming,  and  the  force  size  required  to  satisfy  worldwide  needs  were  questioned.  In  addressing 
these  concerns,  flight  tests  or  exercises  were  not  possible  because  the  system  was  not  then  developed.  Analysis  supported  by  simulation 
and  modeling  was  the  only  available  alternative, 

2.3.1  Survivability 

in  1971  the  U.S.  Department  of  Defense  (DoDy  directed  that  u  study  be  made  of  the  survivability  of  an  AWACSIn  a  European  conflict 
situation  und  that  the  sensitivity  of  the  results  be  related  to  radar  performance  ugulnst  likely  threat  aircraft.  Three  computer  models 
were  required  for  that  study. 

As  expected,  the  rudur  performance  model  was  a  key  one,  During  the  initial  phase  of  the  study,  before  the  Brussbourd  radar  data  was 
available,  theoretical  radar  performance  against  representative  threats  was  all  that  was  available.  Consequently,  the  study  emphasis  was 
on  the  warning  time  and  defensive  support  that  could  be  realized  over  u  broad  range  of  aircraft  detection  ranges,  After  Brassboard  results 
became  available  in  lute  1972  und  1973,  specific  detection  predictions  wore  made  and  the  corresponding  warning  times  and  defense  levels 
could  be  estimuted, 

A  second,  rather  simple  but  effective  model,  which  assisted  in  Illuminating  tile  Issue  of  defensive  fighter  support  for  the  E-3A,  was  the 
tighter  Commit  Envelope  Model,  Requiring  only  u  dozen  lines  of  code,  tills  model  used  the  geometric  relationships  of  distance  and  time 
between  constant  velocity  vectors  representing  a  hostile  panel  rutor  und  friendly  fighter  to  determine  the  locus  or  points  In  the  horizontal 
plane  where  the  defending  fighter  could  reach  u  terminal  engagement  situation  on  the  penetrutor  before  the  penetrutor  could  reach  a 
terminal  engagement  situation  on  the  E-3A  (figure  <>).  The  upi>eul  of  the  upprouch  was  that  the  size  of  the  envelope  depended  primarily 
on  the  E-3A  detection  capability  ugulnst  the  penetrutor,  rather  than  on  the  weapons  capabilities  of  the  respective  aircraft,  which  were 
subject  to  debute.  Because  of  the  eventual  predictions  that  the  E-3A  detection  capabilities  against  threat  aircraft  would  be  aubatantlal, 
and  that  the  resulting  arcus,  or  commit  envelopes,  from  which  fighters  could  be  drawn  would  be  large,  it  was  recognized  that  the  E-3A 
could  provide  the  single  most  Important  Ingredient  both  for  its  own  defense  and  the  defense  of  other  friendly  assets  In  time  of  attack.' 
wurnlng  time  to  react. 

For  those  who  insisted  on  quantitative  estimates  of  the  probability  of  E-3A  survivul  ugulnst  ultucks  by  various  numbers  of  hostile  aircraft 
when  defended  by  various  numbers  of  friendly  fighters,  a  Probability  of  E-3A  Survival  Model  was  developed.  This  short  mathematical 
model  of  a  couple  dozen  FORTRAN  statements  required  estimates  of  the  cumulative  kill  probabilities  of  hostile  aircraft  against  an  E-3A- 
slze  aircraft  und  friendly  ulrcruft  ugulnst  the  hostllcs,  Since  published  data  on  such  probabilities  tended  to  be  overly  specific  and  not 
totully  applicable,  the  model  was  programmed  to  generate  results  parametrically  over  a  range  of  probabilities.  In  Ihe  end,  because  few 
could  agree  on  the  kill  probabilities  that  should  apply,  the  parametric  approach  proved  most  appropriate. 

2.3.2  Mission  Effectiveness 

In  the  general  sense,  mission  effectiveness  bus  been  a  top-priority  Item  In  the  design  of  the  E-3A  system  from  the  beginning.  In  1973, 
however,  Dol)  specifically  asked  for  ussurunce  of  system  effectiveness  in  the  European  environment  before  system  development  could  . 
continue.  A  lurge-scule  uir-buttle  simulation  model,  culled  T AC  PENETRATOR,  was  selected  by  the  U.S.  Air  Force  staff  i’or  analysis  und 
assessment  of  U-3A  mission  effectiveness.  The  simulation  was  run  with  und  without  the  E-3A  to  show  Improvement  resulting  fro.i ,  it  i 
superior  surveillance,  communications,  ami  conimund-und-control. 

Tile  TAC  PENKTRATOR  model  is  an  expected  value  model  that  uses  u  scries  of  53  simultaneous  differential  equations  to  compute  the 
interactions  und  outcome  of  u  tactical  air  battle.  The  model  uses  a  notional  upprouch  and  describes  u  group  of  RED  aircraft  attacking  a 
group  of  BLUE  ussets  defended  by  u  group  of  BLUE  SAMs  and  a  group  of  BLUE  fighters  (figure  7).  The  major  simulation  output  Is  the 
usuul  meusurc  of  effectiveness  of  RED  bombers  on  BLUE  targets,  in  addition  to  statistics  regarding  RED  aircraft  killed,  BLUE  ulrcruft 
killed,  and  SAMs  und  f’  centers  destroyed. 

At  the  risk  of  upstuging  one  of  Ihe  lessons  learned  in  applying  modeling  und  simulation,  comprehensive  air  buttle  simulations  like  this  one 
have  generally  lucked  credibility  for  u  number  of  reasons  to  be  d'seussed  Inter.  In  this  particular  ease,  however,  the  results  obtained  were 
considered  udequute  for  addressing  the  concerns  of  the  then  Deputy  Secretary  of  Defense  because  the  model  bud  several  major  conserva¬ 
tive  assumptions  built  into  it.  Eor  example,  there  were  no  hostile  ulrcruft  aborts;  there  was  effective  RED  groiind-oontrol-intercopt  (CiCi) 
coverage  in  BLUE  territory;  and  RED  kill  probabilities  against  BLUE  ground  turgets  were  unity.  The  conclusion  wus  tlmt,  since  the 
predictions  of  Improvement  were  so  conservative,  they  were  that  much  more  believable. 
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Electronic  Countermeasure  Resistivity 


In  l')74  the  U  S.  Senate  Armed  Service  Committee  Report  on  the  FY75  Authorization  Bill  requested  that  the  Secretary  of  Defense 
appoint  a  group  of  independent  ra  lar  and  electronic  countermeasure  (ECM)  experts  to  examine  in  detail  prior  to  any  production  deci¬ 
sion  the  ECM  resistivity  of  the  E-3A  radar.  In  response  to  this  request  the  Director  of  Defense  Resoarcii  and  Engineering  (DDR&fc) 
appointed  such  a  group  in  August  and  directed  that  the  ad  hoc  committee  report  be  completed  and  submitted  to  the  Secretary  of  De¬ 
fense  and  to  the  Defense  Systems  Acquisition  Review  Council  (DSARC)  by  the  beginning  of  December.  Air  Force/MITRE  simulation 
results  were  a  significant  factor  in  the  Committee's  favorable  assessment. 

A  radar  performance  in  ECM  simulation  was  developed  by  MITRE  to  produce  target  detection  range  plots  as  a  function  of  azimuth  angle 
for  one  or  more  E-3As  in  a  scenario  containing  multiple  noise  Jammers,  Fixed  and  moving  Jammers  could  be  specified,  with  the  detec¬ 
tion  range  results  recalculated  every  so-nteny  minutes.  An  illustration  of  a  typical  simulation  output  is  provided  in  figure  8,  The  model 
assumes  a  constant  (nose-on)  cross  section  for  the  target  class  and  determines  the  effect  of  multiple  noise  jammers  on  F.-3A  detection 
runge  by  an  ulgebraic  formulation  involving  the  detection  range  without  jumming  and  the  jammer-to-nolse  power  density  ratio,  Although 
the  theory  employed  in  the  model  Is  straightforward,  the  program  itself  is  fairly  large,  with  one  main  program  and  eleven  subroutines  to 
determine  the  precise  value.,  to  be  used  in  the  formulation,  The  modei'i  prediction  capability  has  been  confirmed  by  a  number  of 
jammer  flight  tests  that  have  been  conducted  since  the  time  of  its  development. 

The  radar  performance  In  ECM  simulation  model  has  been  used  extensively  since  1 974  to  evaluate  additional  ECM  threat  projections. 

Tlie  model  results  liuvc  provided  keen  Insight  into  the  relative  effects  of  alternative  jammer  tactics  and  the  merits  of  various  electronic 
comiter-countcrmeasurcs  that  may  provide  protection  against  such  tactics. 

2.3,4  Force  Sizing 

The  number  of  E-3  As  required  to  support  various  surveillance  missions  has  been  difficult  to  quantify  precisely  without  a  force  sizing 
computer  model,  In  the  lute  1960’s,durlng  Contract  Definition,  64  E-3As  were  planned  based  on  Air  Force  paper  analysis  of  the  number 
required  to  do  substantial  perimeter  surveillance  of  the  continental  United  States  for  air  defense  and  to  do  limited  tactical  surveillance 
worldwide.  In  1970  the  t  atul  number  of  E-3As  was  reduced  to  42  as  part  of  a  DoD-wlde  budget  cut.  In  addition,  the  Air  Force  had  to 
rethink  the  allocution  of  E-3A  resources  because  the  focus  of  E-3  A  employment  was  shifted  from  U.S,  air  defense  lo  general  purpose 
worldwide  applications,  Lack  of  an  adequate  analytical  tuol  for  providing  DoD  and  congressional  decision-makers  with  insight  into  the 
need  for  u  force  of  this  size  may  have  contributed  to  unother  cut  in  the  E-3A  program  In  1973  to  34  aircraft,  it  was  in  1974  that  the 
first  E-3A  Force-Sizing  Model  became  available  for  Air  Force  studies  and  analysis, 

The  E-3  A  Force-Sizing  Model  is  a  Monte  Carlo  computer  program  that  determines  the  number  of  E-3As  required  to  provide  vurlous  levels 
of  on-stutlon  coverage,  The  program  models  u  scenario  consisting  of  a  ground  operating  base  and  one  or  more  ulrbornc  orbits  (or  sta¬ 
tions).  The  simulation  Includes  the  fly-out  from  base  to  station,  the  on-station  coverage,  the  return  to  base,  and  the  ground  refueling  and 
maintenance  prior  to  unother  mission  (figure  9),  ln-filglit  aborts,  as  well  as  the  variability  in  ground  turnaround  time,  are  modeled  statis¬ 
tically,  The  program  outputs  the  on-stutlon  coverage  that  cun  be  expected  for  the  given  busc-to-stutlon  distances  us  a  function  of  E-3A 
force  size.  In  recent  years  the  model  has  been  generalized  to  project  force-sizing  requirements  for  any  uireruft  of  known  characteristics, 


The  Force-Sizing  Model  bus  been  used  In  design-tradeoff  studies  of  reliability  and  maintainability,  in  employment  studies  to  determine 
the  number  of  uireruft  per  orbit  to  sutlsfy  vurlous  mission  requirements,  and  In  busing  studies  to  assess  the  effects  of  various  fleet  basing 
alternatives  on  force-sizing  requirements, 

The  Force-Sizing  Model  proved  to  be  a  valuuble  tool  In  1975  when  the  NATO  Supreme  Allied  Commander,  Atlantic  (SACLANT)  expres¬ 
sed  Interest  In  the  E-3A  us  u  NATO  Airborne  Early  Warning  system,  One  of  Ills  concerns  was  whether  the  E-3A  could  fulfill  specific 
surveillance  covcrugc  requirements  with  the  ullowable  number  of  aircraft.  Force-sizing  model  results  helped  convince  hint  that  it  could. 

2,4  Dispelling  an  Eurly  Feur;  Tvrruin-Scrccning 

Another  timely  application  of  simulation  showed  that  u  seemingly  obvious  fact  about  an  airborne  rudur  was  actually  a  falsehood,  that  an 
curly  four  and  potentially  serious  concern  were  unfounded.  The  issue  arose  in  19(i7  when  a  cursory  attempt  was  made  to  estimate  the 
effect  on  airborne  rudur  coverage  of  screening  by  terrain.  The  single  eusc  of  a  stationary  E-3A  looking  in  one  azimuth  direction  was 
considered,  The  conclusion  was  that  the  line-uf-sight  range  Vo  a  target  aircraft  would  be  reduced  us  much  as  40  pcrcont  for  the  situation 
where  It  wus  terruln-following  through  mountains.  Neutrally,  this  result  was  disappointing  and  concern  arose  regarding  the  utility  of  air¬ 
borne  rudar  in  mountainous  ureas,  This  concern  was  particularly  Insidious  because  many  people  ucceptcd  the  conclusion  without  question, 
believing  It  to  be  rather  obvious.  Fortunately,  not  everyone  accepted  it  because  it  was  not  based  on  any  detailed  or  extensivo  analysis  of 
terrain-screening  effects  over  rcul  terrain. 

In  1970  u  Torruin-Serecning  Simulation  Model  wus  developed  by  MITRE,  The  model  approach  was  to  determine  whether  a  point  at  a 
given  runge  and  azimuth  is  screened  from  an  observer  position  (on  the  ground  or  In  the  air)  by  terrain  along  the  llnc-cf-sight.  The  terrain 
distribution  wus  approximated  by  dividing  a  gcogruphlc  area  Into  a  large  number  of  grid  rectangles  with  sides  of  constant  latitude  and 
longitude.  At  tacit  corner  coordinate  the. height  of  the  terrain  was  specified  at  a  terrain  duta  point  read  In  by  input  card.  The  size  of  the 
grid  rectangles  could  be  varied,  depending  on  the  accuracy  desired  and  the  irregularity  of  the  terrain.  The  height  at  any  location  was 
determined  by  finding  which  grid  rectangle  the  point  was  in  and  employing  a  linos,'  estimation  technique  based  on  the  terrain  heights  of 
the  four  comer  points.  Reluctivity  of  the  atmosphere  was  approximated  by  a  4/3  earth  radius. 

The  Terrain-Screening  Model  was  applied  satisfactorily  to  the  mountainous  terrain  issue  in  1971,  Detailed  analysis  was  conducted  for  a 
number  of  potential  penetration  routes  into  the  U.S.  over  mountainous  terrain.  Tite  terrain  height  in  the  appropriate  areas  of  Alaska  and 
Canada  was  determined  from  terrain  maps.  The  results  Indicated  tliut  there  were  no  penetration  routes  that  would  result  in  as  drastic  a 
reduction  in  aurvelllancc  us  the  40  percent  projected  by  the  1967  stationary  objerver  analyrls.  The  reason  was  that  the  motion  of  an 
E-3A  resulted  in  rapid  changes  in  the  terrain  distribution,  and  continuous  screening  along  a  given  penetration  route  was  not  possible. 
Another  result  wus  that  the  amount  of  screening  was  reduced  dramatically  as  the  target  height  Increased.  Thirdly,  the  study  results 
showed  that  any  effects  of  terrain-screening  on  long-range,  law-attitude  target  detection  could  be  minimized  by  computer  analysis 
of  the  best  E-3A  orbit  locations  with  respect  to  a  specific  mountain  range,  Lastly,  it  was  effectively  shown  that  multiple  E-3As  with 
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overlapping  coverage  reduced  the  effect  of  terrain-screening  substantially  further  to  the  point  where  the  impact  would  be  minimal. 

In  essence,  what  was  considered  to  be  an  obvious  truth  and  an  unfortunate  fact  of  life  for  airborne  radars  was  shown  to  be  false  at 
a  time  when  program  efforts  had  to  be  focussed  on  other  more  important  concerns  and  system  development  issues.  Subsequent 
experience  during  E-3A  flight  tests  in  the  vicinity  of  mountains  tells  us  that  the  Terrain-Screening  Model  results  were  correct. 

Over  the  last  several  yean  more  precise  terrain  height  data  for  certain  parts  of  the  world  has  gradually  become  available  on  computer 
magnetic  tape  from  the  Defense  Mapping  Agency,  In  1978  the  capability  to  read  and  sort  this  data  was  built  into  the  Terrain-Screening 
Model.  Other  improvements  and  refinements  were  also  incorporated  in  the  model  design.  It  ii  now  possible  to  use  the  model  for  high 
resolution  terrain-screening  analysis  of  geographic  areas  for  which  data  is  available,  such  as  Central  Europe.  An  illustration  of  the  kind  of 
output  than  can  be  obtained  is  piovided  in  figure  10.  The  case  analyzed  was  for  points  on  the  ground,  rather  than  for  ai.-oraft  above  the 
ground. 


2.5  An  Operational  Application:  The  E-3A  Mission  Simulator  * 

A  current  application  of  simulation  on  the  E-3A  Program  is  the  Mission  Simulator.  The  simulator  is  a  facility  at  the  E-3A  Main  Operating 
Base  at  Tinker  AFB  (figure  11)  wherein  E-3A  million  crew  members  may  be  trained  as  an  interactive  and  entire  crew  in  an  operationally 
lifelike  environment.  It  consists  of  an  instructor  area  with  three  multipurpose  consoles  and  four  communication!  simulation  consoles, 
and  a  mission  crew  area  with  nine  multipurpose  consoles,  a  computer  operator's  console,  and  other  display  and  processor  equipments, 
laid  out  like  an  E-3A  airoraft,  The  instructors  control  the  data  being  displayed  on  the  trainee  coneoles  and  provide  simulated  voice  com¬ 
munications  with  the  external  environment,  They  also  monitor  and  assist  the  trainees  in  their  development. 

The  simulation  software  consists  of  the  major  portions  of  the  E-3A  Airborne  Operational  Computer  Program  (AOCP)  for  processing 
mission  data  and  operator  switch  actions,  and  a  full  repertoire  of  simulated  data:  radar  and  IFF  reports,  navigation  data,  digital  com¬ 
munications  information,  electronic  countermeasure  information,  and  a  number  of  selectable  scenario  data  bases  for  added  realism. 

The  Mission  Simulator  is  used  to  train  new  crew  members  in  as  controlled  an  environment  as  possible,  under  close  monitor  supervision, 
prior  to  aotual  flight  training  onboard  an  E-3A  aircraft.  It  is  also  used  to  replay  and  analyze  actual  missions;  data  from  every  mission  is 
recorded  on  magnetic  tape  in-flight.  The  simulator  has  even  greater  capability  in  one  sense  than  the  real  thing  because  the  c  t-.on  can  be 
frozen  in  time  for  analysis  or  explanation, 

In  addition  to  the  Mission  Simulator  is  an  individual  position  trainer  (1PT)  facility,  which  is  used  to  train  operators  in  the  use  of  the 
multipurpose  console  before  being  graduated  into  a  full  crew  environment. 

3.  LESSONS  LEARNED 

The  many  applications  of  modeling  and  simulation  over  the  course  of  E-3A  development  have  provided  opportunities  to  recognize 
several  Important  truths.  Perhaps  the  most  Important  is  that,  no  matter  how  realistic  and  accurate  a  model  Is,  it  will  never  be  as  believ¬ 
able  to  decision-makers  as  actual  system  teats  or  demonstrations.  As  a  result,  simulation  plays  a  less  important  role  the  further  into  a 
program  it  is,  as  more  test  data  becomes  available. 

The  many  applications  of  modeling  and  simulation  have  also  taught  severul  important  lessons.  Throe  are  most  significant: 


1 .  Large  models  are  not  necessarily  better  than  small  models  end  smell  comprehensible  models  ere  always  better 
than  large  incomprehensible  ones. 


As  discussed  in  the  area  of  survivability,  a  small  and  rather  simplistic  interceptor  availability  model  was  perfectly  adequate  in  the  early 
1970s  for  showing  that  the  F.-3  A  could  be  protected  with  interceptor  aircraft,  Data  on  the  respective  kill  probabilities  of  hostile  and 
friendly  weapons  systems  was  subject  to  debate;  consequently,  modeling  the  endgame  was  Inappropriate.  The  effectiveness  of  this 
approach  was  In  sharp  contrast  with  the  Ineffectiveness  of  a  separate  attempt  in  those  days  to  use  the  output  of  a  large,  detailed  Inter¬ 
cept  simulation  to  make  the  same  point.  This  model  had  been  obtained  from  a  contractor  and  It  provided  very  dotalled  results.  The 
problem  was  that  each  model  run  also  produced  certain  curious  results,  and  an  inordinate  amount  of  time  was  required  to  determine  how 
they  could  be  rationalized.  Eventually  the  model  had  to  be  discarded, 

A  pitfall  of  using  large-scale  simulations  is  that  they  may  give  the  illusion  of  modeling  things  to  great  levels  of  detail  when  the  Input  data 
is  not  adequate  to  Justify  such  detail,  This  is  similar  to  the  problem  of  significant  figures,  where  the  result  of  multiplying  several  numbers 
together  is  only  as  precise  as  the  least  precise  number  being  multiplied,  Sometimes  detailed  simulation  Is  not  oven  possible.  Occasionally 
not  enough  is  known  about  the  cuuse-and-effect  relationships  involved  in  some  process  to  model  it.  Perhaps  moat  difficult  is  recognizing 
this  situation  and  biting  one’s  modeling  tongue,  A  better  approach  Is  to  develop  a  number  of  smaller  models  for  those  parts  of  the 
process  that  are  well  understood.  The  results  from  these  models  can  then  be  tied  togothor  as  much  as  possible  under  the  circumstances 
by  the  reasoning  power  or  common  sense  of  the  analyst. 


2.  Application  of  large,  existing  models  to  new  problems  Is  usually  difficult  and  must  always  be  done  with 
great  care. 


Usually,  the  larger  the  model  the  more  specialized  it  Is,  no  matter  how  hard  the  model  developer  attempts  to  make  it  general.  In  1973, 
for  example,  a  large-scale  computer  program  simulating  a  European  air  war  was  obtained  and  adapted  for  some  E-3A  effectiveness 
studies,  It  wua  discovered  in  short  order,  however,  that  the  program  would  have  limited  utility  for  the  task  ut  hand  because  major 
programming  changes  would  be  required  to  add  a  second  E-3A  to  the  simulation, 


The  best  hedge  against  overly  specialized  simulations  is  to  make  them  as  modular  as  possible.  This  was  done  effectively  with  the  E-3A 
Long-Form  Radar  Simulation  and  the  Radar  Performance  Prediction  Models,  beginning  with  the  AMTI  routines  mentioned  previously. 


Parts  of  the  Long-Form  program  and  several  of  the  AMT!  routines  are  still  in  use  today.  Rather  than  attempting  to  force  a  new  problem 
to  fit  an  old  model,  the  more  effective  approach  has  been  to  develop  a  specific  executive  or  main  program  that  will  call  all  required 
modules,  some  of  which  may  have  to  be  developed  specifically  for  the  problem  at  hand. 

A  cardinal  rule  for  developing  simulations  that  are  to  be  saved  for  future  use  is  to  document  them  fully.  Many  models  are  developed  by 
people  who  leave  the  project  or.  worse,  the  company,  without  documenting  their  work.  These  models  are  then  useless  unless  someone 
can  be  given  time  to  explore  them  thoroughly  and  document  them,  if  this  is  even  possible,  depending  on  the  transparency  of  model 
design, 


3.  Large,  multi-system  effectiveness  models  are  the  leeit  credible  of  all  models  because  they  are  the  most 
difficult  to  apply  correctly. 


Of  all  the  models  and  simulations  used  during  the  E-3A  program,  the  large-scale,  multi-system  effectiveness  models  had  the  least  utility. 
One  or  more  of  the  requirements  for  successful  application  of  this  type  of  model  were  usually  violated, 

One  requirement  is  that  all  model  constraints  and  assumptions  be  well  understood  and  the  caveats  advertised  widely,  Also,  the  sensi¬ 
tivity  of  the  results  to  changes  In  the  assumptions  must  be  known  for  the  results  to  be  meaningful,  One  analysis  of  E-3A  effectiveness 
conducted  in  1973  at  first  encountered  criticism  because  enemy.ECM  was  not  adequately  modeled,  Upon  further  analysis,  however, 
this  was  found  to  be  a  conservative  assumption  In  terms  ol'  the  model's  measure  of  effectiveness:  the  Improvement  In  surveillance  and 
C3  due  to  the  addition  of  the  E-3A.  The  reason  was  that  the  E-3A  It  far  lets  susceptible  to  ECM  than  other  systems  of  Its  class  that 
comprise  the  C3  network,  Surprise,  concern,  and  debate  could  have  been  avoided  by  widely  advertising  the  model  ground  rules  and 
assumptions, 

Another  requirement  Is  that  every  model  mechanism  and  algorithm  be  understood  and  Judged  appropriate.  Sometimes  the  inappro- 
priatcnesi  of  a  particular  algorithm  In  a  model,  particularly  In  u  large  model,  can  go  unnoticed,  i.e.,  If  the  ruiults  are  not  contrary  to 
common  sense.  In  this  situation  the  analysis  la  worthless,  but  no  one  knows  it.  In  most  cases,  fortunately,  the  process  of  varying  the 
input  parameters  and  conducting  sensitivity  analyses  uncovers  those  hidden  lapses  from  reality.  In  1972,  for  example,  a  large-scale 
war  game  simulation  waa  uied  to  determine  the  improvement  in  the  outcome  of  a  battle  at  a  result  of  the  introduction  of  the  L-3A, 

To  everyone’s  surprise  the  outcome  was  worse,  It  seemed  that  additional  warning  time  was  not  a  good  tldng.  More  detailed  analysis 
revealed,  however,  that  the  interceptor  allocation  algorithm  was  inappropriate.  Consequently,  the  greater  the  warning  time  the  sooner 
the  allocation  and  the  worse  the  outcome, 

Perhaps  the  mori  fundamental  requirement  for  successful  use  of  systems  effectiveness  modeling  is  that  the  model's  measures  of  effec¬ 
tiveness  be  appropriate  to  the  problem  at  hand.  One  E-3A  effectiveness  study,  for  example,  was  substantially  handicapped  because  the 
model  used  measured  the  C3  effectiveness  of  an  Isolated  E-3  A  versus  that  of  the  ground  C3  environment.  The  proper  measure  should 
have  been  the  complementary  effectiveness  of  a  combined  E-3A/grouml  environment  capability  versus  the  capability  of  the  ground 
environment  alone. 

Another  effectiveness  study  employed  a  model  that  listed  as  one  of  the  key  measures  of  effectiveness  the  number  of  hostile  fighters 
killed  versus  the  number  of  friendly  fighters  killed.  Addition  of  the  B-3A  in  certain  scenarios  resulted  in  a  decrease  in  the  number  of 
hostile  fighters  killed  and  an  increase  In  the  number  of  friendly  lighten  killed.  By  the  above  measure  of  effectiveness,  this  would  have 
meant  addition  of  the  E-3A  was  counterproductive.  It  turned  out,  however,  that  the  number  of  hostile  fighters  killed  decreased  because 
the  more  effective  surveillance  and  C2  provided  by  the  E-3A  permitted  more  friendly  fighters  to  avoid  Intercepting  hostile  lighters  to 
conserve  their  weapons  for  use  against  hostile  bombers  and  fighter-bombers.  The  number  of  friendly  fighters  killed  Increased  because 
considerably  more  of  the  fighters  wore  brought  Into  the  conflict  as  a  result  of  the  earlier  warning  provided  by  the  E-3A.  Tiie  measure  of 
effectiveness,  therefore,  was  misleading  and  Inappropriate. 

4,  CONCLUSIONS 

This  paper  has  presented  just  a  sampling  (summarized  In  figure  12)  of  the  various  applications  of  modeling  and  simulation  to  the  devel¬ 
opment  of  the  E-3A.  Many  truths  concerning  the  modeling  and  simulation  process  were  made  apparent  and  many  lessons  were  learned. 
Yet  the  most  encompassing  truth  clearly  stands  out  -  models  and  simulations  are  necessary  and  important  tools  In  the  development  of 
any  avionics  and  C'3  system, 

They  can  be  used  for  such  diverse  applications  as  subsystem  and  system  design,  performance  prediction,  system  advocacy,  and  even 
crew  training.  If  used  carefully  and  prudently,  modeling  and  simulation  can  provide  a  crucial  service  In  the  system  design  process  snd, 

In  addition,  fill  many  of  the  knowledge  gaps  encountered  along  the  development  path. 
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Figure  l_  E-3A  Interior  Layout 
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Figure  2.  Block  Diagram  of  E-3A  Radar  Design 
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Figure  3,  Antenna  Array  Face 
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Figure  4,  Close-up  View  of  E-3A  Radome 


Figure  5.  AM  I'I  Program  Modular  Design 
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Figure  6.  Illustration  of  Fighter  Defense  Envelope 


Figure  7  Notional  Approach  of  TAC  PENETRATOK  Model 


BASED  ON  HYPOTHETICAL  ANTENNA  PATTERN  POR  E-3A 


Figure  8.  Illustration  of  Performance  In  ECM  Program  Output 


BLOCKS  REPRESENT  AIRCRAFT  STATES 
ARROWS  REPRESENT  MAIN  TRANSITIONS 
BETWEEN  STATES 


Figure  9,  Force  Sizing  Model  Design 


•  SCREENING  AT  GROUND  LEVEL 

•  AREA  OF  FULDA  GAP  IN  WEST  GERMANY 

•  E-3A  160  NMI  TO  WEST  AT  29,000  FT 


Figure  1 2.  Summary  of  Modeling  and  Simulation  During  E-3A  Program 
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ABSTRACT 


The  Naval  Air  Development  Center  is  developing  a  software  life-cycle  rapport 
facility  for  the  E-3A  Navigational  Computer  System  (NCS).  The  heart  of  this  facility  is 
a  real-time  environmental  simulator  which  is  used  to  simulate  both  E-3A  avionics  and  the 
operational  environment  so  that  software  problems  with  the  included  AN/ARN-120  Omega  Navi¬ 
gation  Equipment  (ONE)  can  be  investigated  and  that  the  Impact  of  software  changes  can  be 
assessed  by  a  simulated  mission  refly.  The  ONE  contains  a  16-bit  embedded  minicomputer. 

The  environmental  simulator  is  a  hybrid  system  hosted  in  two  digital  computers 
connected  by  a  specially  designed  real-time  digital  data  link.  Real-time  simulation  soft¬ 
ware  performs  two  distinct  functions:  provides  computer-controlled  analog  and  digital 
input  data  to  the  ONE  and  respond  to  ONE  guidance  outputs,  and  provides  "truth-model" 
aircraft  data  which  can  be  used  as  a  precision  navigation  reference. 

The  paper  presents  preliminary  experience  related  to  the  design  and  construction 
of  the  environmental  simulator  for  the  software  life-cycle  support  facility,  describes 
some  of  the  practical  problems  encountered  in  developing  the  simulator,  presents  interim 
resolution  and  potential  long-term  solutions,  and  discusses  current  status.  Particular 
emphasis  is  placed  on  describing  procedures  used  for  implementing  the  simulator  development 
guidelines:  maximum  flexibility  and  minimum  essential  design. 


1.  INTRODUCTION 


1.1  The  E-3A  Navigational  Computer  System  Software  Life-Cycle  Support  Facility 


The  E-3A  Navigational  Computer  System  (NCS)  is  an  integrated  multisensor  naviga¬ 
tion  system  consisting  of  dual  Dclco  AN/ASN-119  Inertial  Navigation  Equipments  (INE),  a 
Ryan  AN/APN-213  Doppler  Velocity  Sensor  (DVS),  and  a  Northrop  AN/ARN-120  Omega  Navigation 
Equipment  (ONE).  Three  embedded  computers  are  used  in  the  NCS:  two  inertial  computers 
(one  per  INE)  and  an  Omega  computer  in  the  ONE.  System  integration  is  performed  in  the 
ONE  using  a  24  state  Kalman  filter.  A  functional  flow  diagram  of  the  NCS  is  shown  in 
Fig.  1  (Northrop,  1975). 

The  primary  purpose  of  the  Software  Life-Cycle  Support  Facility  (LCSF)  is  to 
provide  support  to  the  U.S.  Air  Force  in  maintsinlng  the  operational  ONE  program.  (Support 
of  the  operational  INE  programs  is  not  a  responsibility  of  the  NCS  Software  LCSF.)  The 
software  maintenance  task  Involves  developing  the  capability  to  detect  errors  in  the  opera¬ 
tional  software,  to  change  the  software  and  test  the  chsnges ,  and  to  produce  field- 
installable  versions  of  the  software.  These  capabilities  represent  the  design  goals  for 
the  NCS  Software  LCSF. 

The  NCS  Software  LCSF  consists  of  two  separate  facilities:  a  Program  Generation 
Facility  (PGF)  and  an  Environmental  Simulation  Facility  (ESF).  The  PGF  will  be  uaed  to 
modify  source  code  and  assemble  new  program  versions.  The  ESF  will  be  used  to  test  the 
software  in  a  dynamic  environment  similar  to  that  encountered  in  an  E-3A.  The  power  and 
flexibility  of  the  ESF  is  derived  from  the  real-time  environmental  simulator  (ES):  a 
hybrid  system  hosted  in  two  digital  computers  connected  by  a  specially  designed  real-time 
digital  data  link. 


1.2  Relationship  of  the  LCSF  to  Air  Force  Requirements 


The  F.-3A  system  development  is  managed  for  the  United  State*  Air  Force  by  the 
E-3A  System  Program  Office  (SPO),  Electronic  Systems  Division,  Air  Force  Systems  Command. 
The  user  is  Air  Force  Tactical  Air  Command  (TAC),  and  maintenance  responsibility  ultimately 
rests  with  Air  Force  Logistics  Command  (AFLC).  As  part  of  its  development  mission,  the 
E-3A  SPO  entered  into  an  agreement  with  the  Naval  Air  Development  Center  (NADC)  to  design 
and  build  a  software  LCSF  tor  the  E-3A  NCS. 
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Development  of  the  LCSF  began  in  1976.  Since  the  beginning  of  the  development, 
the  design  and  development  of  the  LCSF  has  been  reviewed  by  E-3A  SPO,  TAC  and  AFLC  repre¬ 
sentatives.  Current  plans  call  for  NADC  to  assist  in  the  transition  of  the  LCSF  to  AFLC 
by  1984. 


1.3  Organization  of  the  Paper 


This  paper  is  organized  into  four  sections.  Section  1  presents  an  overview  of 
the  LCSF  and  its  relationship  to  Air  Force  requirements.  Section  2  discusses  the  principal 
goals  of  the  LCSF,  its  hardware  organization,  and  the  software  organization  of  the  envi¬ 
ronmental  simulator.  Section  3  describes  the  development  of  the  facility  (with  primary 
emphasis  on  the  simulator)  and  discusses  problems  encountered,  their  solution,  and  lossons 
learned.  Section  4  contains  a  brief  summary  of  the  development  and  describes  the  current 
status  of  the  LCSF. 


2.  SOFTWARE  LIFE-CYCLE  SUPPORT  FACILITY 

2.1  Objectives 


The  E-3A  NCS  Software  LCSF  is  designed  to  provide  the  software  engineer  with  the 
capability  to  perform  specific  software  maintenance  tasks.  From  this  perspective,  six 
facility  functions  have  been  identified: 

•  Problem  Report  Evaluation  -  determine 
from  a  system  deficiency  report  whether 
a  specific  problem  has  a  software  remedy 

s  Algorithm  Modification  and  Program  Genera¬ 
tion  -  make  a  specific  change  to  an  algo¬ 
rithm  in  the  ONE  software,  change  the 
code,  and  produce  a  new  program  version 

•  Software  Change  Verification  -  test  the 
change  to  ensure  it  meets  specification 
and  provide  capability  to  debug  new  soft¬ 
ware 

•  Baseline  Verification  -  perform  automated 
testing  to  ensure  old  capabilities  are 
not  lost  and  new  errors  have  not  been 
generated 

«  Change  Tape  Production  -  produce  a  field 
installable  version  of  the  new  program 

•  Configuration  Control  and  Documentation  - 
provide  rigid  control  of  user  and  LCSF 
software. 


The  environmental  simulator  plays  an  important  role  In  problem  report  evaluation 
and  software  change  verification,  and  it  is  the  Drimary  tool  for  baseline  verification. 

The  relationship  of  these  steps  to  the  overall  system  problem  resolution  sequence  is  depict¬ 
ed  by  the  shaded  areas  in  Fig.  2. 


2.2  Hardware  Organization 


The  LCSF  useB  two  computers  in  addition  to  the  ONE  computer:  a  Hewlett-Packard 
HP-2113  is  used  as  an  interface  processor  and  a  Control  Data  Corporation  CDC  6600  which 
hosts  the  simulation  software.  The  HP-2113  controls  all  data  flow  within  the  LCSF  and 
handles  seven  interfaces:  two  simulated  INE  interfaces,  the  control  for  the  Canadian 
Marconi  Company  Omega  signal  simulator  (which  simulates  the  radio  frequency  Omega  signal), 
a  simulated  DVS  interface,  the  instrumentation  (telemetry  port)  interface  to  the  ONE,  the 
data  link  to  the  CDC  6600,  and  the  operator  interface  (through  peripherals).  All  of  ths 
simulation  software  executes  on  the  CDC  6600. 

The  LCSF  has  the  necessary  hardware  to  add  a  real  INE  for  interface  and  data 
transfer  testing  with  the  ONE.  (Mission  refly  cannot  be  accomplished  with  the  real  INE, 
because  it  is  not  possible  to  reproduce  anything  but  a  ona-g  static  field  in  the  labora¬ 
tory.)  Additional  peripherals  provide  the  capability  to  generate  field-installable  pro¬ 
grams  on  cassette  tapes  and  communicate  with  a  remote  International  Business  Machines  IBM 
370  computer  which  hosts  the  ONE  assembler.  The  hardware  configuration  of  the  LCSF  is 
summarized  in  Fig.  3. 


2.3 


Software  Organization 


The  real-time  simulation  software  resides  in  the  CDC  6600  computer  and  can  be 
divided  into  five  functional  categories 

•  Simulation  Control 

•  Trajectory  Generator 

a  Inertial  Navigation  Model 
a  Omega  Signal  Model 
a  Doppler  Model. 

The  data  flow  between  these  modules  is  depicted  in  Fig.  4. 

Because  of  the  architecture  of  the  host  computer,  the  simulation  control  function 
Includes  both  normal  simulation  executive  functions  and  Input/output  functions.  It  synchro¬ 
nizes  the  simulator  software  with  the  200  msec  cycle  of  the  interface  processor,  schedules 
simulation  events  and  invokes  necessary  modules  to  complete  the  10-sec  major  simulation 
cycle.  Simulation  control  also  handles  the  data  transfer  to/  from  the  interface  processor 
at  a  200  msec  rate. 

The  trajectory  generator  (Berry,  P.W.,  1979)  provides  all-latitude  simulation  of 
the  E-3A  aircraft  and  includes  a  guidance  function  to  handle  simulated  pilot  steering, 
waypoint  steering  normally  accomplished  ly  the  ONE-selected  preferred  INE,  and  pattern 
steering  in  response  to  ONE  steering  commands.  It  contain*  earth  and  gravity  models  and 
computes  a  specific  force  profile  for  use  in  the  inertial  navigation  model.  The  trajec¬ 
tory  generator  provides  truth-model  navigation  data  for  evaluating  ONE  performance. 

The  Inertial  navigation  model  simulates  the  navigation  and  alignment  functions 
of  the  INE  and  functions  in  three  modes:  ground  alignment,  inflight  alignment  and  navigate. 
To  save  simulation  time,  the  ground  alignment  mode  may  execute  an  accelerated  alignment 
sequence.  Two  distinct  INEs  are  modeled  in  the  inertial  navigation  model. 

The  Omega  signal  model  supplies  amplitude  and  phasa  data  for  eight  Omega  trans¬ 
mitting  stations  on  the  three  primary  frequencies  (10.2  kHz,  11.33  kHz  and  13.6  kHz)  which 
correspond  to  the  simulsted  aircraft  position.  Atmospheric  noise  data  is  also  supplied 
in  this  model,  and  Omega  anomalies  (phase  and  amplitude  biases,  and  solar  flare-induced 
Sudden  Ionospheric  Disturbances  and  Polar  Cap  Anomalies)  are  modeled.  To  save  development 
effort,  the  propagation  portion  of  the  phase  model  is  a  version  of  the  U.S.  Coast  Guard 
propagation  model,  PROP2  (Morris,  P.B.,  1974),  and  the  amplitude  model  is  derived  from  an 
Air  Force  VLF  amplitude  program,  POWER FLUX  (Lewis,  E.A. ,  1975).  Both  programs  were  modi¬ 
fied  to  execute  in  real  time. 

** 

The  doppler  model  simulates  DVS  inputs  to  the  ONE  and  operates  in  two  modes: 
over-land  and  over-water.  It  transforms  trajectory  generator  data  to  the  proper  coordinate 
frame. 


The  simulation  software  Is  summarized  in  Table  1  according  to  these  functional 
divisions.  The  table  liats  approximate  program  size  In  lines  of  source  code,  describes 
the  major  characteristics  of  algorithm  development,  and  summarizes  additional  software 
characteristics.  (Program  size  data  do  not  include  storage  requirements  for  large  data 
arrays . ) 


3 •  FACILI1Y  DEVELOPMENT 


3.1  Development  Approach 


Development  of  the  LCSF  is  a  team  effort.  The  Navigation  Systems  Design  Branch, 
Communication  Navigation  Technology  Directorate,  NADC  has  overall  responsibility  for  the 
LCSF  and  acts  as  both  system  engineer  and  development  engineer  for  interface  processor 
applications.  The  Syetems  Simulation  Department,  Systems  Directorate,  NADC  serves  as 
simulation  consultant  and  la  responsible  for  developing  the  simulation  software.  TASC 
serves  as  technical  consultant  on  the  E-3A  NCS  and  on  LCSF  usage:  TASC  also  designed  the 
models  for  the  ES.  Computer  Sciences  Corporation  is  developing  software  for  the  Inter¬ 
face  processor. 

Design  of  the  ES  software  emphasized  maximum  use  of  existing  software  with  minimal 
new  development  effort.  As  indicated  in  Table  1,  approximately  40%  of  the  simulation 
software  is  a  modification  of  existing  software.  (This  includes  the  relatively  high  risk 
models  for  Omega  signal  amplitude  and  diurnal  phase  shifts.)  These  modifications  were 
designed  to  provide  equivalent  data  in  useable  format  in  real  time,  and  the  original  soft¬ 
ware  provided  excellent  verification  tests  for  the  modified  code. 


TABLE  1 

SUMMARY  OF  SIMULATION  SOFTWARE 


T-1920 


MODULE 

FUNCTION 

PROGRAM  SIZE 
(LINES  OF 
SOURCE  CODE) 

ALGORITHM 

CHARACTERISTICS 

SOFTWARE 

CHARACTERISTICS 

Simulation 

Control 

4200 

New  Design 

■>v 

Approx.  2300  Lines  HOI,  and 

1900  Lines  of  Assembler  for 
Interface  Processing 

Trajectory 

Generator 

1300 

Moderate  Modification 
to  Proven  Design 

Modular;  All  HOL 

Omega  Signal 
Models 

3700 

Minor  Modifications 
to  Existing  Design 

Five  Major  Submodules;  All  HOL; 
Excellent  Tests  Available 

Inertial 

2200 

New  Design 

Four  Major  Submodules;  All  HOL 

Utiii ties 

600 

— 

Includes  Data  Formatting;  Mostly 
HOL 

Doppler  Model 

300 

New  Design 

Two  Major  Submodules;  All  HOL 

TOTAL 

12,300 

Team  Development  Effort 

Mostly  HOL;  High  Degree  of  Modu¬ 
larity;  Executes  in  Real  Time 

*HOL  =  High  Order  Language  (CI)C  Fortran) 

3.2  Problems,  Solutions,  and  Lessons  Learned 


Numerous  minor  problems  arose  during  the  design  and  initial  development  of  the 
LCSF,  and  additional  "opportunities  to  excel"  are  anticipated.  Four  specific  problem 
areas  and  their  solutions  are  described  below. 

The  most  serious  problem  faced  by  the  Air  Force  was  scheduling.  The  decision  to 
construct  a  software  LCSF  was  reached  after  the  software  waB  provisionally  accepted  by 
the  Air  Force  and  while  initial  deliveries  of  the  E-3A  were  being  made  to  the  user.  There¬ 
fore,  the  LCSF  was  "late"  the  day  the  decision  to  build  it  was  made.  The  solution  to 
this  problem  vbb  to  construct  two  ES  facilities!  the  final  version  described  above  and 
an  interim  facility  with  limited  simulation  capability  that  could  be  ready  sooner.  The 
Interim  simulation  facility  uses  all  of  the  interfaces  needed  for  the  final  facility,  is 
hosted  only  by  the  interface  processor,  and,  therefore,  can  be  used  to  perform  most  of 
the  systems  integration  testing  before  all  of  the  final  simulation  software  has  been  coded 
and  tested. 

Documentation  of  the  hardware  Interfaces  to  the  ONE  is  less  than  adequate  for 
the  design  task  faced  by  NADC.  In  particular,  design  decisions  and  supporting  rationale 
and  motivations  were  missing  from  the  package  delivered  to  the  Air  Force.  The  problem  is 
not  that  the  equipment  contractors  did  not  fulfill  their  responsibility  in  the  context  of 
developing  the  E-3A  NCS  --  they  did;  rather,  the  problem  is  the  changing  scope  and  purpose 
to  which  the  contractual  deliverables  were  applied.  Only  partial  solutions  have  been 
found,  and  the  interfaces  still  represent  a  risk  item  in  facility  development.  The  lesson 
learned  from  this  experience  is  that  all  interfaces  to  embedded  computers  must  be  thor¬ 
oughly  documented  and  understood  at  the  time  of  hardware/software  acceptance  if  the  soft¬ 
ware  maintenance  task  is  to  be  accomplished  by  an  external  agency. 

Two  pieces  of  limited  production  Special  Test  Equipment  (STE)  were  used  by  the 
equipment  manufacturer  in  developing  and  testing  the  E-3A  NCS.  This  equipment  was  not 
purchased  by  the  Air  Force  to  support  the  NCS  during  its  life-cycle.  Instead,  special 
interface  cards  have  been  designed  for  the  interface  processor  to  provide  visibility  into 
the  ONE  software  and  eliminate  the  need  for  this  equipment. 

The  device  used  to  load  the  ONE  program  in  the  field  was  supplied  as  Government 
Furnished  Equipment  (GFE)  to  the  prime  contractor.  As  such,  a  single,  largely  undocumented 
procedure  for  generating  cassettes  containing  the  load  module  of  the  operational  program 
using  the  STE  was  the  only  method  available  when  this  effort  began.  The  problem  was  to 
eliminate  the  requirement  for  the  STE  and  provide  a  more  efficient  procedure  for  generat¬ 
ing  change  tapes.  A  solution  was  achieved  in  close  cooperation  with  the  equipment  prime 
contractor,  but  substantial  manpower  resources  were  committed  to  the  problem  before  a 
solution  was  achieved.  The  lesson  learned  from  this  experience  is  that  the  prime  contractor 
must  be  made  responsible  (and  compensated)  for  ensuring  that  adequate  documentation  exists 
for  all  software  and  equipment  necessary  t.o  produce  new  program  versions  even  If  CFE  is 
involved. 


Although  these  problems  were  encountered,  development  of  the  LCSF  is  proceeding 
according  to  schedule  and  will  contribute  to  successful  accomplishment  of  the  Air  Force 
support  mission  for  E-3A.  It  is  anticipated  that  the  first  NADC-generated  software  change 
to  the  NCS  program  will  be  fielded  in  1980. 


4  SUMMARY 


The  E-3A  NCS  Software  LCSF  is  being  constructed  at  NADC  to  support  the  ONE  soft¬ 
ware.  Part  of  the  LCSF  is  an  environmental  simulator:  a  hybrid  system  hosted  in  two 
digital  computers  connected,  by  a  specially  designed  real-time  digital  data  link.  Simula¬ 
tion  software  is  used  to  generate  a  realistic,  all-latitude  aircraft  trajectory  generator, 
models  for  two  INEs  which  simulate  three  operational  modes  (ground  alignment,  inflight 
alignment,  and  navigate),  a  doppler  radar  model,  and  models  for  calculating  Omega  signal 
amplitude,  noise,  phase  and  propagation  effects  under  nominal  and  disturbed  propagation 
conditions . 

To  meet  scheduling  requirements,  the  LCSF  will  be  constructed  in  two  stages. 

The  first  stage,  an  interim  simulator,  will  be  completed  in  December  1979,  and  will  pro¬ 
vide  the  capability  to  test  the  ONE  software  as  well  as  exercise  all  of  the  facility  hard¬ 
ware  interfaces.  The  final  configuration  is  scheduled  for  completion  in  July  1980. 

The  Air  Force/Navy  interservice  arrangement  for  constructing  the  LCSF  has  been 
very  productive  in  providing  the  expertise  and  tools  necessary  to  build  the  facility  ac¬ 
cording  to  the  tight  schedule.  It  is  anticipated  that  the  capabilities  designed  into  the 
facility  will  provide  a  cost  effective  procedure  for  producing  and  testing  new  software 
for  the  ONE,  Applying  analytical  insights  about  ONE  operations  to  the  task  of  designing 
the  LCSF  has  already  demonstrated  cost  savings  in  the  design  of  the  simulation  software, 
and  it  is  expected  that  the  benefits  will  become  more  apparent  when  the  LCSF  becomes  fully 
operational. 
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A-JT.IPS  PERFORMANCE  MODEL  FOR  THE  E-3A 
James  6,  Tailor 
Boeing  Aerospace  Company 
Seattle,  Washington,  USA 

SUMMARY 

This  paper  describes  the  communications  link  performance  model  developed  to  predict  performance  of  JTIDS 
(Joint  Tactical  Information  Distribution  System)  links  between  the  E-3A  and  other  aircraft  and  ground 
stations.  The  JTIDS  Is  a  time  division  multiple  access  system  operating  In  the  radio  frequency  band  962 
to  1213  MHz  and  employs  spread  spectrum  techniques. 

The  model  Is  unique  as  It  Includes  the  performance  effects  on  the  JTIDS  wideband  frequency  hopping  re* 
celver  due  to  both  the  E-3A  dual  antenna  system  and  specular  and  diffuse  multipath  signals. 

Laboratory  tests  were  conducted  which  provided  receiver  performance  data  for  signals  routed  through  dual 
antenna  and  multipath  simulators.  This  simulator  approach  was  also  used  In  similar  tests  conducted  by 
SHAPE  Technical  Centra  for  NATO.  The  results  were  essentially  Identical  In  the  tro  test  programs. 

A  flight  test  program  was  conducted  which  validated  the  link  performance  modal.  This  validated  model  has 
greatly  reduced  costly  E-3A  flight  testing  and  hat  provided  predictions  of  JTIDS  performance  over  a 
variety  of  eomunlcatlon  link  scenarios  and  flight  conditions, 

1 .  INTRODUCTION 

This  paper  describes  the  communication  link  performance  model  that  was  developed  and  used  during  the  USAF 
sponsored  program  that  Integrated  the  JTIDS  (Joint  Tactical  Information  Distribution  System)  Class  I 
terminal  Into  the  E-3A  (AWACS)  aircraft.  The  JTIDS  It  a  time  division  multiple  access  communication 
system,  which  operates  within  the  radio  frequency  band  962  to  1213  MHz  and  employs  spread  spectrum 
techniques,  l.e.,  pseudo-random  bit-encoding  within  each  Information  pulse  and  pulse-to-pulse  frequency 
hopping.  The  JTIDS  as  Installed  In  the  E-3A  utilizes  a  dual  antenna  system,  one  antenna  In  the  nose 
radonte  directed  forward,  the  other  In  a  tall  cone  radome  directed  aft.  The  two  antennas  are  separated  by 
a  nominal  126  wavelengths  and  therefore  produce  Interferometer  lobes  at  bearing  sectors  nominally 
centered  at  90 P  and  27CP. 

A  communications  link  performance  prediction  model  was  developed  to  predict  JTIDS  link  performance  between 
the  E-3A  and  other  air  and  ground  terminals.  This  modal  was  developed  because  of  the  necessity  to  provide 
link  performance  predictions  for  a  multitude  of  link  types,  link  geometries,  aircraft  headings,  aircraft 
altitudes,  terrain  types  and  atmospheric  fade  situations.  The  alternative  method  was  flight  testing  which 
would  have  been  prohibitively  expensive  If  all  parameter  combinations  were  tested. 

The  conmunl cations  performance  model  Is  unique  because  It  Includes  not  only  effects  of  the  conmon  link 
parameters  such  as  transmitter  power,  receiver  sensitivity,  antenna  gain,  cable  losses  and  atmospheric 
fade  losses}  but  also  performance  effects  on  the  JTIDS  wideband  frequency  hopping  receiver  due  to  the  dual 
antenna  system  and  specular  and  diffuse  multipath. ' 

This  performance  model  was  validated  by  verifying  that  the  performance  predicted  using  the  link  performance 
modal  compared  favorably  with  measured  performance  derived  from  flight  test  data  collected  during  the  E-3A 
flight  test  program. 

2.  E-3A  JTIDS  SYSTEM 

I 

JTIDS  Is  a  joint  services  tactical  communications  system.  JTIDS  terminals  will  be  provided  on  the  E-3A, 
and  other  military  aircraft  and  ground  stations.  The  first  Implementation  of  JTIDS  was  on  the  E-3A, 

JTIDS  users  transmit  and  receive  on  a  common  channel.  Thus,  all  users  have  access  to  the  same  Information 
In  real  time.  The  JTIDS  Is  nodelesst  l.e.,  no  communications  center  is  required  since  all  users  transmit 
to  all  other  users.  Thus,  loss  of  ar\y  one  terminal  or  groups  of  terminals  will  not  prohibit  communl cation 
within  the  other  surviving  users. 

The  JTIDS  basic  time  division  Is  the  time  slot  (duration  7.8125  ms):  there  are  128  time  slots  per  second. 
The  next  higher  level  Is  a  cycle  which  has  a  duration  of  12  seconds  or  1536  time  slots.  The  highest  level 
Is  an  epoch  which  Is  64  twelve  second  cycles  or  12.8  minutes.  Figure  1  provides  a  pictorial  view  of  the 
time  division  architecture,  A  user  can  be  assigned  for  transmission  a  m'nlmum  of  one  time  slot  per  epoch 
and  a  maximum  number  depending  on  the  transmit  duty  cycle  limitations  Imposed  by  transmitter  design  and  by 
electromagnetic  compatibility  considerations.  The  number  of  transmit  time  slots  assigned  to  a  user  depends 
on  the  function  of  the  user.  In  a  single  JTIDS  net  only  one  user  can  transmit  during  a  single  time  slot. 
Multlnet  operation  Is  also  possible. 

The  JTIDS  operates  In  the  TACAN  (Tactical  Air  Navigation)  band,  l.e.,  962  to  1213  MHz.  It  Is  a  spread 
spectrum  system  which  utilizes  pseudo-random  bit  encoding  on  each  transmitted  pulse  and  pseudo-random 
ftequency  hopping  on  a  pulse  to  pulse  basis.  A  message  includes  a  synchronization  preamble, four  track  re¬ 
fining  symbols,  and  109  symbols  of  data.  A  symbol  consists  of  two  6.4  psec  pulses  separated  by  6.6  psec 
and  contains  S  channel  bits. 
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t.  E-3A  JTIDS  Syston  (Continued) 

Reed-Sol omon  forward  error  correction  encoding  Is  used  to  reduce  transmission  errors  In  each  225  Information 
bit  formatted  message.  The  basic  Reed-Sol omon  codeword  1$  a  (31,  15)  codeword  containing  31  five  bit  data 
symbols  of  which  15  are  Information  symbols  and  16  are  parity  symbols.  Three  of  thesj  blocks  form  the  225 
bit  message.  The  message  header  Is  a  (16,  4)  codeword  (a  shortened  (31,  15)  codeword)  with  four  Information 
symbols  and  12  parity  symbols. 

The  E-3A  JTIDS  uses  a  dual  antenna  system)  one  horn  antenna  Is  located  above  the  weather  radar  In  the 
forward  radome  and  Is  directed  forward.  The  other  horn  antenna  Is  located  In  a  tall  cone  and  Is  directed 
aft.  This  antenna  system  was  implmentad  to  provide  high  and  low  elevation  angle  coverage  and  to  provide 
optimum  electromagnetic  compatibility  with  other  on-borrd  systems.  The  two  antennas  are  locatad  approxi¬ 
mately  126  wavelengths  apart;  hence  an  Interferometer  lobe  region  exists  on  both  sides  of  the  aircraft 
(Refer  to  Figure  2).  The  'pacing  between  nulls  of  the  Interferometer  lobes  Is  approximately  0.4°.  The 
antenna  radiation  pattern  (Figure  2)  was  taken  using  an  1/7th  scale  model  E-3A  and  depicts  the  gain  profile 
at  an  elevation  angle  of  0°.  The  measurement  was  made  at  a  scale  RF  of  7000  MHz.  which  Is  eaulvalent  to 
1000  MHz.  This  pattern  Is  typical  of  the  antenna  radiation  characteristics  throughout  the  band. 

3.  LINK  PERFORMANCE 

The  communication  link  performance  prediction  model  defines  link  performance  as  a  function  of  many  communi¬ 
cation  system  and  propagation  parameters.  The  measures  of  performance  Include  message  error  rate  (MER), 
range,  link  availability  and  link  margin.  Link  availability  is  the  probability  that  the  message  quality 
(MER  averaged  over  an  appropriate  sample  period)  meets  or  exceeds  an  MER  acceptable  for  the  user  (one  per¬ 
cent,  for  JTIDS).  Link  availability  Includes  the  normal  statistical  fluctuations  due  to  atmospheric  fading 
(Longley,  A.6.,  1968)  and  the  effects  of  other  fluctuations  In  received  signal  level  caused  by  changes  In 
range  and  variations  In  antenna  gain,  The  latter  are  due  to  aircraft  heading,  altitude  and  attitude 
changes.  Link  margin  Is  the  difference  between  the  received  signal  level  and  the  signal  level  required  to 
provide  the  den  red  MER. 

The  unlaue  features  of  this  model  are  the  Inclusion  of  the  dual  antenna  system  radiation  pattern,  effects 
of  the  dual  antenna  system  on  receiver  performance  and  effects  of  specular  and  diffuse  multipath  reflections 
on  receiver  performance.  This  model  also  Includes  the  usual  communication  link  parameters}  l.e. ,  trans¬ 
mitter  power,  coaxial  cable  losses  and  receiver  MER  versus  signal  level  characteristics.  Atmospheric 
absorption  and  atmospheric  fading  loss  aspects  are  based  on  a  Boeing  developed  propagation  model 
(Livingston,  R.  C. ,  1971)  which  Is  conceptually  similar  to  the  Longley-RIcn  (Longin'.,  A.  S..  1968)  propaga¬ 
tion  modal . 

As  discussed  In  paragraph  2.,  the  antenna  radiation  pattern  consists  of  major  patten  lubes  In  the  forward 
and  aft  regions  and  Interferometer  lobes  In  the  broadside  regions  (Figure  2).  See model  azimuth  radiation 
patterns  were  taken  for  elevation  conics  in  three  degree  elevation  angle  Increments  from  -16°  to  15° 
relative  to  the  aircraft  centerline.  Both  maximum  and  minimum  gain  values  ware  taken  from  the  radiation 
pattern  In  two  degree  azimuth  Increments.  The  difference  botween  the  peak  antenna  and  the  minimum  gain  Is 
the  peak  gain  to  null  depth  ratio  (In  dB). 

The  models  which  describe  the  effects  of  the  dual  antenna  system  and  specular  and  diffuse  multipath  are 
discussed  In  paragraphs  3,1  and  3.2.  Tha  accuracy  of  the  prediction  modal  (excluding  atmospheric  fading 
and  terrain  multipath  aspects)  was  validated  by  an  extanslve  flight  tast  program  (paragraph  5.)  Flight 
time  was  not  available,  however,  to  validate  the  terrain  multipath  modal. 

3.1  Dual  Antenna  Modal 

The  antenna  gain  of  the  JTIDS  dual  antenna  systini  cannot  be  determined  at  all  azimuth  anglet  In  tha  con¬ 
ventional  manner  due  to  the  effect  of  the  antenna  system  on  the  performance  of  the  receiver.  As  noted  In 
paragraph  2,,  the  antenna  radiation  pattern  In  tha  fore  and  aft  azimuth  sectors  centarad  at  0°  and  180° 

Is  similar  to  a  conventional  antenna  pattern  (no  Interferometer  nulls)  and  the  effective  antenna  gain  Is 
the  peak  gain  of  the  radiation  pattern  at  the  particular  azimuth  angle. 

However,  the  receiver  Interacts  with  the  antenna  Interferometer  lobes  which  occur  at  azimuth  sectors 
nominally  centered  at  90°  and  270°.  Hence,  a  different  antenna  gain  model  was  developed  for  the  Inter¬ 
ferometer  lobe  regions.  The  receiver-antenna  system  Interaction  Is  described  as  follows.  The  azimuth 
angle  of  each  Interferometer  null  varies  with  changes  In  radio  frequency  (RF).  When  the  Incoming  JTIDS 
signal  direction  of  arrival  (DOA)  Is  within  the  Interference  null  region,  the  antenna  gain  will  vary  from 
pulse-to-pulsa  as  the  RF  hops  in  a  pseudo-random  manner  throughout  the  JTIDS  frequency  band.  Since  the 
terminal  utilizes  Read-Solomon  error  correction  decoding  and  processes  entire  messages,  the  antenna  gain 
will  depend  on  the  following:  the  signal  DOA,  the  antenna  gain  variations  with  RF,  the  particular  hop 
frequencies  selected  and  the  processing  capability  of  the  receiver. 

The  resulting  antenna  gain  Is  larger  than  tha  minimum  gain  (the  null  depth)  but  less  than  the  peak  gain 
because  of  the  rece1v'*-dua1  antenna  system  Interaction,  In  Figure  3,  the  peak  antenna  gain  Is  reduced 
by  a  factor  aSi  (for  peak  galn-to-null  dapth  ratio  of  10  dB)  due  to  this  Interaction.  This  reduction  In 
antenna  gain  or  receiver  degradation  In  the  presence  of  Interferometer  lohas  Is  a  function  of  azimuth 
angle  and  peak-to-null  ratio  and  is  determined  by  tha  laboratory  measurements  described  In  paragraph  4.1. 
These  measurements  provided  data  for  MER  versus  signal  level  curves  similar  in  nature  to  Figure  4. 


17-3 


i 


i 

I 

t 

t 


3.1  Dual  Antenna  Model  (Continued) 


Figure  4  contains  a  reference  curve  which  Indicate*  the  receiver  performance  at  the  peak  antenna  gain  with 
no  Interferometer  lobe*.  The  other  curves  show  receiver  performance  operating  In  an  Interferometer  channel 
wltn  peak-to-null  ratio*  of  3  und  10  dB.  The  curves  Indicate  that  an  Increase  In  signal  level  above  the 
reference  level  Is  required  for  the  receiver  to  operate  In  an  Interferometer  channel  at  the  same  HER.  This 
ln  **fl?*T  level  In  dBi  a.g.,  aS-]  (10  dB  peak-to-null  ratio),  Is  subtracted  from  the  peak  gain 
(dBI)  to  determine  the  effective  antenna  gain  (dBi). 


Manv  curves  of  the  type  presented  In  Figure  4  were  generated  from  laboratory  measurements  (See  Paragraph 
4.1).  Each  curve  was  based  on  a  combination  of  azimuth  angle  and  peak-to-null  depth  as  derived  from  the 
antenna  radiation  pattern  data.  The  azimuth  a>g1e  Is  an  Important  parameter  as  It  directly  affects  the 
time  delay  between  signal  arrival  at  each  of  the  antennas. 


At  each  azimuth  angle  In  the  Interferometer  region,  the  peak  gain  and  peak-to-null  ratio  are  taken  from 
tho  antenna  pattern  and  the  time  delay  Is  calculated.  The  increase  In  receive  signal  (AS)  required  to 
operate  In  the  Interferometer  channel  Is  obtained  from  the  MER  v$  signal  level  curve  for  each  particular 
time  delay  and  peak-to-null  ratio.  Then  the  effective  antenna  gain  is  the  peak  antenna  gain  minus  the 
Increase  In  receiver  signal  level,  AS. 


3.2  Multipath  Model 


The  previous  section  described  the  model  of  the  Interaction  between  the  dual  antenna  systsm  and  the 
receiver.  This  paragraph  will  discuss  the  E-3A  JTIDS  multipath  model. 

It  Is  widely  acknowledged  that  many  narrowband  conrnunlcation  systems  are  very  susceptible  to  multipath 
degradation.  An  Important  performance  feature  of  the  wideband  spread  spectrum  JTIDS  receiver  Is  that  It 
inherently  provides  good  performance  In  a  multipath  environment.  To  validate  this  premise,  the  JTIDS 
multipath  performance  was  measured  In  the  laboratory  using  JTIDS  terminals  and  specially  developed 
multipath  simulators  (see  paragraph  4.2).  These  laboratory  testa  demonstrated  that  JTIDS  hat  very  good 
multipath  performance. 


The  multipath  model  was  developed  by  first  predicting  the  multipath  environment  and  then  meaaurlng  JTIDS 
receiver  performance  In  this  simulated  environment,  The  multipath  environment  consists  of  path  delay 
and  reflection  attenuation  as  a  function  of  aircraft  altitudes,  range,  terrain  type,  terrain  roughneas 
and  terrain  electrical  characteristics. 


Differential  path  delay  (hereafter  referred  to  at  path  delay),  l.a.,  time  delay  between  the  direct  and 
reflected  signals,  Is  an  Important  environmental  parameter  because  the  receiver  multipath  performance  Is 
sensitive  to  time  delay.  Path  delay  was  related  to  aircraft  altitudes  and  range  by  using  well  known 
geometrical  relationships.  Figure  5  presents  the  time  delay  between  the  direct  and  reflected  signals  as 
a  function  of  altitude  of  one  aircraft  and  range  between  that  aircraft  and  tha  E-3A  when  the  E-3A  was  at 
an  altitude  of  30,000  feet. 

Reflection  attenuation  was  determined  as  a  function  of  aircraft  altitudes,  range  between  the  aircraft, 
terrain  type  and  terrain  roughness  through  a  specially  developed  computer  program.  The  program  considers 
the  effects  of  the  wldebaom  JTIDS  antenna  system  as  It  illuminates  the  earth's  surface  and  calculates  both 
the  specular  and  diffuse  reflection  components.  These  components  were  used  to  calculate  the  specular  to 
diffuse  power  ratio  and  the  total  reflected  power. 

The  reflected  signal  was  judged  to  be  entirely  specular  whan  the  spocular  tp  diffuse  power  ratio  exceeded 
10  dB  and  antirely  diffuse  when  the  ratio  was  less  than  -10  dB,  Specular  and  dlffute  multipath  were  each 
simulated  separately  In  the  laboratory. 


Figure  6  presents  the  reflected  power  attenuation  for  rolling  hills  as  a  function  of  one  aircraft  altitude 
and  range  between  that  aircraft  and  the  E-3A  when  the  E-3A  was  at  an  altitude  of  30,000  feet.  The  rolling 
hills  had  average  ground  electrical  properties  and  an  rms  height  variation  of  40  wavalangths.  This  very 
rough  surface  produces  an  almost  totally  diffuse  reflected  signal. 

The  values  of  multipath  time  delay  and  reflection  attenuation  uied  In  the  laboratory  tests  were  based  on 
those  values  In  Figures  5  and  6  that  ware  within  the  JTIDS  E-3A  communication  ranga  and  altitude  limits  of 
the  other  aircraft. 


The  laboratory  tests  provided  MER  as  a  function  of  signal  level  for  these  values  of  time  delay  and  re¬ 
flection  attenuation.  An  example  of  this  multipath  performance  characteristic  is  plotted  In  Figure  7. 

Note  that  the  signal  leval  must  be  Increastd  In  a  multipath  environment  In  order  to  provide  the  same  MER 
as  achieved  In  a  non-multipath  environment. 

Using  the  laboratory  data,  multipath  lones  at  a  message  quality  of  one  percent  MER  were  determined  ai  a 
function  of  time  delay  and  reflection  attenuation.  This  data  was  combined  with  the  data  in  Figures  5  and 
6  to  produce  multipath  loss  contours  as  a  function  of  one  aircraft  altitude  and  range  between  that  air¬ 
craft  and  the  E-3A,  when  the  E-3A  was  at  an  altitude  of  30,000  feet.  Figure  B  shows  the  multipath  loss 
contours  for  rolling  hills  when  the  MER  is  one  percent.  The  multipath  loss  contours  In  rolling  hills  do 
not  Include  the  attenuation  effects  of  vegetation  on  the  ground  reflection  signal.  Hence,  the  contour 
values  may  be  reduced  if  vegetation  Is  present.  Unfortunately,  reliable  models  do  not  exist  at  1000  MHz 
that  allow  prediction  of  that  attenuation.  Hence  resulting  JTIDS  diffuse  multipath  degradation  predictions 
tend  to  be  conservative,  l.e.,  are  upper  bounds. 


4. 


LABORATORY  SIMULATION 


The  techniques  used  to  simulate  ths  E-3A  dual  antenna  system  and  multipath  In  order  to  determine  their 
effects  on  the  JTIDS  receiver  performance  are  discussed  In  the  following  paragraphs. 

SHAPE  Technical  Centre  (STC)  conducted  Independent  specular  and  diffuse  multipath  tests  using  the  JTIDS 
terminal  (Schml,  R..  1978)u  The  STC  multipath  simulation  was  Implemented  In  .a  different  manner  than 
the  Boeing  simulator.  Both  STC  and  Boeing  used  coaxial  cabin  to  provide  the  required  time  delay.  The 
delay  in  the  Boeing  tnts  was  provided  at  the  JTIDS  radio  frequency.  However,  the  STC  test  configuration 
translatad  the  operating  frequency  to  an  Intermediate  frequency  where  the  time  delay  was  Implemented  and 
then  up-converted  back  to  the  JTIDS  operating  frequency.  The  results  of  both  STC  and  Boeing  tests  were 
comparable. 

4.1  Dual  Antenna  System  Simulation 

The  dual  antannn  system  was  simulated  by  splitting  the  signal  Into  direct  and  delayed  paths  and  recombin¬ 
ing  them  prior  to  the  receiver  (Figure  9.).  The  direct  signal  simulates  signal  arrival  at  on*  antenna 
while  signal  arrival  at  the  second  antannA  Is  dal  ay  ad  and  raduead  In  amplitude  relative  to  the  first 
antenna  depending  on  tha  signal  OOA.  Various  time  delays  of  th*  signal  at  the  second  antenna  were 
achieved  by  using  coaxial  cables  of  different  lengths.  Tha  peak-to-null  ratio  was  adjusted  by  setting  an 
attenuator  In  th*  delayed  signal  path.  For  example.  If  the  attenuator  were  adjusted  to  provide 
equal  loss  In  both  direct  and  reflected  paths,  this  would  provide  the  situation  where  the  gains  of  both 
antennas  were  equal  (nominally,  off  tha  E-3A  wings)  and  would  result  In  a  very  large  (theoretically 
Infinite)  peak  gain  to  null  depth  ratio.  The  JTIDS  frequency  hopping  will  cause  a  random  variation  In 
the  phase  difference  between  the  signals  In  the  direct  and  delayed  paths  and  results  In  Interference 
nulling  corresponding  to  tha  actual  antenna  system  nulling. 

Azimuth  angle  sectors  were  defined  and  the  time  delay  corresponding  to  the  sector  midpoint  was  determined. 
Appropriate  peak  antenna  gain  to  null  depth  ratios  were  determined  for  each  angular  sector  from  th* 
measured  radiation  patterns  of  the  antenna  system  mounted  on  a  l/7th  scale  model  of  the  C-3A.  Receiver 
performance  degradation  curvet,  l.e..  MER  versus  signal  level  curves  similar  to  Figure  4,  were  then 
measured  for  many  combinations  of  time  delay  and  pesk  gain  to  null  depth  ratios. 

4.2  Multipath  Simulation 

As  discussed  In  Section  3.2.  both  specular  and  diffusa  multipath  ware  simulated  In  th*  laboratory.  Th* 
multipath  simulation  was  similar  In  approach  to  the  dual  antenna  simulation  but  covered  a  wider  range  of 
time  delays.  As  Indicated  In  Figure  6,  the  time  delay  can  range  from  0  nanoseconds  to  greater  then  one 
microsecond  as  a  consequence  of  the  possible  ranges  between  the  E-3A  and  another  aircraft  and  the  possible 
altitudes  of  that  aircraft.  Therefore,  multipath  time  delays  of  0,  100,  200,  300,  450  and  600  nanoseconds 
were  used,  The  various  tlina  delays  were  simulated  by  using  coaxial  cables  of  appropriate  lengths. 

The  reflection  attenuation  was  provided  by  setting  an  attenuator  located  In  the  reflected  signal  path.  Tha 
attenuator  values  were  0,  3,  6,  9  and  12  dB. 

Th*  specular  multipath  simulator  Included  a  direct  path  and  single  reflected  path.  Hence,  the  simulator 
configuration  was  the  same  as  tha  dual  antenna  simulator  (Figure  9)  except  for  the  different  sat  of  time 
delays. 

Diffuse  multipath  reflection  from  the  earth's  surface  can  be  characterized  hy  a  sum  of  many  ropllcas  of  th* 
same  signal  with  different  delays.  The  replica  sum  has  a  Rayleigh  probability  density  for  the  signal 
magnitude  and  a  uniformly  distributed  phase  angle.  To  provide  a  model  .that  Is  a  reasonable  approximation 
of  these  conditions,  the  signal  1$  split  Into  a  direct  and  a  delayed  path.  The  delayed  path  Is  further 
divided  Into  N  paths  with  each  path  Including  a  random  phase  shift  device  (Aranguren,  W.  L . ,  1973  and 
Schwartz.  M.,  1966).  The  N  paths  are  then  sunned  and  dslayad  before  passing  through  an  attenuator.  The 
signal  statistics  at  the  output  of  the  attenuator  will  have  a  Rayleigh  distributed  envelope. 

Rather  than  using  random  phase  shifters,  th*  basic  signal  properties  of  JTIDS  were  used  to  provide  random 
phase.  Properly  chosen  delay  lines  to  provide  operation  over  the  JTIDS  bandwidth  were  used  which  resulted 
In  a  uniform  distribution  of  phase  angles  when  tne  output  of  these  delay  lines  was  combined.  Th*  random 
phase  for  each  fixed  time  delay  was  provided  on  a  pulse  to  pulse  basis  as  a  consequence  of  the  JTIDS 
frequency  hopping.  The  use  of  six  delay  lines,  l.e.,  N>6  paths,  closely  approximates  the  desired  Rayleigh 
distribution.  Time  delays  of  8,  10,  15,  19,  26  end  38  nanoseconds  produce  the  same  effect  as  If  random 
phase  shifters  were  used;  1,e.,  six  signals  are  provided  which  have  statistically  Independent,  uniformly 
distributed  random  phases.  Figure  10  snows  the  multipath  simulator  used  In  the  Boeing  tests. 

In  developing  the  multipath  simulator  for  the  JTIDS  terminal,  It  was  Important  to  evaluate  the  accuracy  of 
the  simulation  and  the  tolerances  required  of  certain  components.  Tha  number  of  delayed  paths  used  to 
simulate  terrestrial  multipath  determines  the  accuracy  of  simulating  the  Rayleigh  characteristics. 

Computer  simulations  of  2,  3,  4,  5  and  6  paths  revealed  that  six  paths  were  required  to  produce  a  good 
approximation  to  Rayleigh  statistics.  Flgurn  11  compares  th*  magnitude  of  the  six  path  simulator  to  tha 
Ideal  Rayleigh  distribution.  A  larger  number  of  paths  would  produce  an  even  more  accurate  simulator. 

The  tolerable  variation  of  the  simulator  output  due  to  different  attenuations  of  the  different  lengths  of 
csblas  used  to  simulate  the  various  time  delays  was  also  examined.  It  was  determined  that  variations  In 
output  level  up  to  6  dB  did  not  materially  degrade  the  accuracy  of  th*  Rayleigh  simulation.  Since  the 
cable  lengths  were  short  and  had  attenuation  differences  less  than  2  dB,  the  output  variations  were  within 
6  dB.  Hence,  the  different  cable  attenuations  did  not  affect  the  accuracy  of  simulating  the  Rayleigh 
distribution. 


5. 


MODEL  VALIDATION 


The  link  performance  model  described  In  the  preceding  sections  was  validated  by  comparing  link  performance 
derived  from  flight  test  data  with  performance  predicted  using  the  link  performance  model.  An'  E-3A  flight 
test  program  was  Implemented  which  provided  flight  test  data  to  determine  link  performance  as  a  function 
of  range  and  signal  DOA.  The  flight  profiles  were  designed  to  provide  short  renge  communication  links  In 
order  to  Insure  clear  llne-of-slght  propagation  paths  and  to  minimize  effects  of  atmospheric  propagation 
anomalies.  All  flight  profiles  were  designed  to  have  straight  line  ground  tracks  and  zero  aircraft  roll 
angles  In  order  to  enhance  flight  profile  repeatability. 

The  flight  test  program  used  a  JTIDS  configured  E-3A  transmitting  to  a  ground  facility  to  collect  air-to- 
ground  performance  data.  Flight  profiles  were  chosen  to  provide  date  when  1)  the  E-3A  nose  and  tall  were 
oriented  toward  the  ground  station  and  2)  the  Interferometer  lobes  In  the  broadside  regions  were  oriented 
towards  the  ground  station. 

A  small  but  Important  change  was  made  to  the  JTIDS  ground  station  configuration.  An  attenuator  was 
Inserted  In  the  receive  path  prior  to  the  first  radio  frequency  amplifier.  The  attenuator  was  used  to 
reduce  the  signal  lavel  at  the  receiver  Input  to  achieve  message  error  rates  at  or  near  the  specified 
level  of  one  percent.  The  value  of  the  attenuator  setting  Is  the  link  margin.  I.e.,  the  difference  between 
the  signal  level  at  the  receiver  and  the  signal  level  required  to  provide  the  specified  MER.  Thus,  the 
attenuator  provided  the  means  to  determine  the  Incoming  signal  level  at  the  receiver.  The  use  of  receiver 
AGO  or  other  conventional  means  to  measure  the  received  signal  level  are  not  practical  for  the  wideband 
spread  spectrum  signals  utilized  In  JTIDS. 

The  E-3A  to  ground  link  was  the  test  link  and  had  the  attenuator  In  the  receive  path  at  the  ground  station. 
The  ground  to  E-3A  link  was  not  attenuated  and  therefore  was  a  reference  link.  The  reference  link  was 
monitored  to  Insure  that  the  JTIDS  terminals  and  tha  link  were  operating  properly. 

The  flight  test  profile  used  to  determine  link  margin  and  MER  In  the  forward  or  aft  direction  of  the  E-3A 
Is  shown  In  Figure  12A.  A  straight  line  ground  track  was  used}  the  aircraft  either  flew  toward  the 
ground  station  or  away  from  the  ground  station.  As  the  E-3A  flew  toward  or  away  from  the  ground  site,  the 
attenuator  was  varied  at  the  ground  receiving  terminal  and  the  resulting  HER  monitored  In  reel  time.  The 
goal  was  to  provide  an  attenuator  value  that  would  result  In  a  one  percent  MER  at  some  renge.  The  atten¬ 
uator  wes  first  adjusted  to  produce  an  MER  within  a  value  of  0.4  to  0.8X  or  2  to  10X  If  the  aircraft  flew 
away  or  toward  the  ground  site.  As  the  E-3A  flew  away  from  the  ground  site,  the  range  Increased  which 
Increased  the  propagation  path  loss.  Since  the  attenuator  setting  was  fixed,  the  Increased  loss  caused 
the  MER  to  Increase  to  one  percent  or  greater.  Conversely,  whan  the  E-3A  flew  toward  the  ground  station, 
the  range  and  therefore  the  propagation  loss  decreased.  As  tha  attenuator  setting  was  fixed,  the  reduction 
In  path  loss  caused  the  MER  to  decrease  to  one  percent  or  less. 

This  process  was  repeated  several  times  during  each  pass.  The  most  meaningful  data  was  collected  at  ranges 
greater  than  50  nml  as  It  was  essential  that  the  elevation  angle  of  the  E-3A  relative  to  the  ground  station 
did  not  appreciably  change  during  the  measurement  period  In  order  to  minimize  changes  in  antenna  gain. 

Changes  In  range  were  compensated  during  analysis  of  the  data  by  adjusting  the  attenuator  setting  by  the 
factor  20  log  R/Ro  where  Ro  Is  any  convenient  reference  range.  An  example  of  a  measured  MER  characteristic 
Is  plotted  In  Figure  13. 

The  flight  profile  used  to  obtain  data  on  JTIDS  performance  for  signal  DOA  within  the  Interferometer  region 
Is  presented  In  Figure  123,  As  Indicated,  a  straight  line  ground  track  was  flown  and  the  pilot  attempted 
with  good  success  to  keep  the  roll  angle  at  0°.  The  above  attenuator  procedure  could  not  be  used  for  the 
broadside  flight  profile  shown  In  Figure  12B,  because  the  antenna  gain  changes  rapidly  with  changes  In 
azimuth  angle.  Hence,  the  following  procedure  was  required.  The  attenuator  setting  was  held  constant 
throughout  the  entire  round  trip  from  position  X  to  position  Y  and  back  to  position  X  (Figure  1ZB).  Then, 
three  additional  passes  were  made,  each  at  different  attenuator  settings.  MER  was  measured  every  12  seconds, 
I.e.,  once  every  JTIDS  cycle,  throughout  each  pass.  The  data  was  then  available  as  a  function  of  attenuator 
setting,  range  and  aircraft  azimuth  angle.  The  azimuth  angular  region  over  which  the  data  was  collected 
was  divided  Into  angular  sectors  of  two  degrees  and  the  data  allocated  to  the  appropriate  sector.  For  each 
angular  sector,  MER  versus  attenuation  setting  was  plotted  and  the  attenuation  setting  corresponding  to  a 
specified  MER,  e.g.,  one  percent  was  determined.  Generally,  two  to  three  data  points  were  useful  in  an 
azimuth  sector,  because  as  expected,  some  of  the  MER's  were  either  OX  or  100X. 

For  each  12  second  JTIDS  cycle,  the  following  Items  were  measured  or  calculated;  MER,  range,  aircraft 
attitude,  ground  azimuth  angle,  aircraft  depression  and  ground  elevation  angles.  As  part  of  the  broadside 
data  analysis,  all  ranges  were  normalized  to  50  nml  and  the  attenuation  values  corrected  accordingly.  Tha 
MER  versus  attenuation  data  wes  examined  to  verify  that  It  was  monotonic,  I.e.,  that  the  MER  Increased  with 
Increasing  attenuation.  Very  little  data  was  discarded  for  being  non-monotonlc. 

Tha  link  margin  for  these  flights  was  predicted  using  the  communication  link  performance  model.  The  pre¬ 
dictions  were  based  on  the  exact  geometries  and  aircraft  attitudes  experienced  during  tha  flight  tests. 

A  link  performance  prediction  was  made  for  every  12  seconds  of  flight  testing  using  actual  geometrical  and 
flight  data,  I.e.,  E-3A  attitudes,  range,  altitudes,  and  position,  that  corresponded  to  each  JTIDS  12 
second  cycle. 


Finally,  the  predicted  link  margin  wai  compared  to  the  link  margin  derived  from  flight  test  data.  This 
comparlion  was  based  on  the  evaluation  of  many  Independent  measurements  and  Indicated  that  the  prediction 
model  was  conservative,  l.e.,  the  actual  margin  was  generally  greater  than  predicted  (See  Table  1). 

Hence,  the  model  can  be  used  to  provide  high  confidence  predictions  of  link  performance  for  different 
links,  altitudes,  aircraft  attitudes  and  geometries. 


TABLE  1.  COMPAR’SON  OF  PREDICTED  AND  MEASURED  LINK  MARGIN 


E-3A  ORIENTATION  DIFFERENCE  BETWEEN  PREOICTED 

TO  GROUND  STATION  AND  MEASURED  LINK  MARGIN  IN  dB 


NOSE  -4 
TAIL  +1 
RIGHT  SIDE  -4 
LEFT  SIDE  -5 


6.  CONCLUSION 

A  JTIDS  communications  link  performance  model  for  the  E-3A  has  been  described  with  emphasis  placed  on  the 
unique  capability  for  predicting  performance  of  a  wideband  frequency  hopplnq  spread-spectrum  transmitter/ 
receiver  operating  with  dual  antennas  In  a  specular  and  diffuse  multipath  channel.  Laboratory  measure¬ 
ments  of  JTIDS  receiver  performance  In  tha  presence  of  a  simulated  dual  antenna  and  simulated  multipath 
channel  were  conducted.  This  data  was  comparable  with  the  data  collected  during  Independent  STC  testing. 
Descriptions  of  the  dual  antenna  and  multipath  simulators  were  presented  to  assist  other  organizations  In 
developing  their  own  simulators. 

The  performance  prediction  model  (excluding  the  multipath  portion)  was  validated  through  collection  of 
JTIDS  E-3A  to  ground  station  link  flight  test  data  and  comparing  tha  measured  link  performance  with  pre¬ 
dicted  link  performance.  Details  of  the  flight  test  program  and  test  data  analysis  procedures  were 
presented. 

The  method  of  using  an  attenuator  to  determine  received  signal  level  was  presented.  This  technique  Is 
applicable  to  other  communication  systems  where  conventional  received  signal  strength  measurements  cannot 
be  made. 

The  validated  JTIDS  performance  prediction  model  has  provided  predictions  of  JTIDS  link  performance  over 
a  variety  of  communication  scenarios  and  flight  conditions  and  therefore  has  eliminated  the  necessity  for 
additional  costly  E-3A  flight  tasting  to  determine  communication  performance. 
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Fig.  1 2  Flight  test  profiles 


A  MISSION  TRAINING  SIMULATOR  FOR  THE  NIMROD  MR  MK  2  AND  SOME  ASPECTS 
OF  THE  DERIVATION  ANO  VERIFICATION  OF  ITS  SYSTEM  MODELS 


K.  HELLS 

SIMULATION  GROUP  MANAGER 

Marconi  Spacr  and  Dafanca  Systems  Limited,  Hllland,  Fife,  Scqtland 


SUMMARY 

Thia  papar  ia  divided  into  i.wo  uaparata  and  diatinot  a  action  a.  Tht  fir  at  aaotion  outline*  the 
function  and  facilitiaa  of  a  Miaaion  Training  Simulator  for  tha  Nimrod  MR  Hk .  2  aircraft  and  the  eecond 
aaotion  ralataa  to  tha  dnrivation  and  verification  of  the  system  modules  for  auch  a  simulator. 


1.  A  MISSION  TRAINING  SIMULATOR  FOR  THE  NIMROD  MK  MK  2 
1.1  GENERAL 

Tha  traditional  rolaa  of  tha  fixed  wing  MR  (Maritime  Reconnaiaaance)  alroraft  ara  variadi 
i.a.  maritima  surveillance,  ASH,  search  and  raeaua,  ate.  During  theaa  rolaa  thare  ara  oftan  parioda  of 
intanaa  concantration  required  from  tha  craw  mambara  during  which  complax  and  aubjactlva  data,  from  a 
variaty  of  aanaori,  mutt  ba  apaadily  and  aocurataly  intarpratad  and  ocrralatad  ao  that  tha  corract 
tactical  daolaiona  ara  mada.  in  ardor  to  maintain  a  high  laval  of  oonoantration,  both  aa  an  individual 
aanaor  oparator  and  aa  a  member  of  tha  craw,  each  craw  man  muat  ba  totally  familiar  with  ourrant  targat 
■anaor  information  aa  wall  aa  ourrant  tactics,  mtanslve  training  muat  ba  diractad  toward*  this  total 
crew  capability  -  tha  Miaaion  Training  Simulator  fulfill  thia  role. 

Tha  initial  requirement  for  the  minion  simulator  was  formulatad  in  tha  mid  aixtiaa  prior  to  tha 
introduction  into  aarvice  of  tha  Nimrod  Hk.  1,  Thraa  Mk.  1  simulator*  subsequently  entered  service  with 
tha  Royal  Air  Fora*  in  tha  aarly  aavantias. 

Each  simulator  provides  the  capabilities  for  intagratad  craw  training  in  all  operational 
missions.  Thai*  missions  range  from  tha  basin  to  tha  moat  complax,  and  tha  oraw  may  ba  trainsd  in  a 
complata  miaaion  covering  the  full  range  of  operational  rolaa  applicable  to  tha  Nimrod.  This  capability 
ia  availabla  for  not  only  tha  ab  initio  trainee  but  alio  for  the  experienced  operational  crew  in 
continuation  training. 

Tha  simulator  provide*  a  high  level  of  simulation  of  moat  anvironuantal  and  targat  affects, 
tha  training  bsing  oarriad out  under  the  control  and  aurvaillanca  of  a  team  of  instructors. 

Tha  aimulator  aompriias  a  fusel ago ,  tha  intaricr  of  whioh  provide*  an  aoourata  representation 
of  tha  Nimrod  Senior  and  navigational  araa.  Within  thia  araa,  aanaor,  oomsuni cation*,  navigation  and 
taotical/waapona  systems  art  reproduced.  To  achieve  tha  proper  psychological  involvemant  from  tha 
traineaa,  thare  ia  no  'over  tha  ehoulder'  instruction)  initsad,  instruction  is  undertaken  from  an 
externally  situated  instructor  conaole, 

Currently,  tha  simulators  arc  undergoing  Jt  major  avionics  rafit  to  rsflect  tha  ohangaa  in  tha 
RAF' a  Nimrod  MR  Mk.  2.  This  rafit  nauuiaitatai  tha  modification  to  Mk.  2  standard  of  the  two  prim* 
aanaor  systems,  acoustics  and  radar.  In  addition,  tha  navigation  and  cantral  tactical  systems  art 
being  updated.  Tha  modifications  both  to  tha  acoustics  and  to  the  radar  will  be  discussed  in  some 
detail  in  thia  papar. 

The  acoustics  equipment  consists  of  two  identical  satsi  each  sat,  comprising  control,  processing 
and  display  facilitiaa,  can  proa***  and  display  data  from  a  wide  range  of  sonobuoys  either  singly  or  in 
various  mixes.  System  operation  Is  based  upon  a  digital  computer  sub-system  in  which  is  risidant  high 
level  language  implemented  software.  Each  operator  is  provided  with  e  CRT  display,  chart  recorders  and 
keyboard  facilitiaa  for  tha  control  of  processing  operations.  Data  received  at  tha  system  is  synchronised 
With  alroraft  refarencen  befura  being  gain-normaliiad,  digitised  and  filtered.  Tha  data  ia  than 
suitably  formatted  for  conversion  from  tha  tims  domain  to  the  frequency  domain  for  display.  At  each 
operation,  tha  oparator  nas  control  ovar  all  processing  parameter*  such  u  sampling  rates,  filtering 
bandwidth,  magnification  factors,  integration  time  constants,  and  so  on,  Targat  data  such  aa 
identification  and  tracking  can  be  transferred  to  tha  cantral  tactical  ayatam  for  correlation  with  other 
aanaor  date. 

The  radar  is  a  ’■  lgh  resolution,  anti-submarine  radar  with  a  long  rang*  aurvaillanca  capability. 
3aa  Clutter  performance  ia  achiavad  by  tha  us*  of  frequency,  apacial  end  temporal  characteristics  of 
aea  clutter  and  by  the  automatic  creation  of  a  threshold  reference  to  the  background  clutter.  The 
resulting  decrease  in  false  alarms  presented  on  the  radar  display  enables  detection  of  snail  targets  in 
high  sea  atatea  without  impairing  long  rang*  performance  against  large  targat*.  Processing  ia  digital 
computer  bused  allowing  tracking  and  classification  of  detected  targets.  The  processed  video  is  seen 
converted  and  presented  on  a  raster  scan  type  display  which  gives  the  oparator  tha  choloe  of  a  number  of 
display  presentation  modes,  including  standard  PPI,  B  scope  and  high  resolution  A  scope.  Two  secondary 
rudara  are  integrated  into  the  orimary  radar  system,  these  being  an  IFF  and  an  I-band  interrogator.  Tha 
coded  replies  received  by  tha  secondary  radar  ara  praaantad  on  tha  primary  radar  display. 

Simulation  is  baasd  upon  tha  ua*  of  unmodified  avionics  systems  including  tha  associated 
operational  flight  software.  Thus  the  acouatio  simulation  starts  at  tha  output  of  tha  receiver  -  all. 
things  'external'  to  and  including  tha  receiver  being  simulated  and  all.  things  'inwards'  being  as 
aircraft.  In  a  similar  manner  tha  radar  simulation  produaaa  signals  corresponding  to  the  output  of 
the  Fi  detector  of  the  diaperaiv#  unit. 
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His  simulation  involves  ths  mod ailing  of  a  larga  number  of  facilities  aaaociatad  with  both  the 
avionics  systems  an*  tl.i.lr  operational  environment.  It  can  ba  sunnarisad  as  the  provision  to  the 
trainee  operators  of  appropriate  visual  a. \d  audio  stimuli,  each  of  which  reaots  in  real  time  in  a 
realistic  manner  in  accordance  with  the  dynamically  changing  exercise  scenario  as  initially  spaciflsd 
and  subssquently  uontro Vied  by  the  instructor*.  Those  stimuli  oonrpriss  target  and  environmental 
characteristics  whioh  are  controlled  by  the  instructors. 

An  outline  of  tha  functions  of  tha  Simulator  for  Nimrod  MR  Hk.  2  Acoustics  and  Radar  is  given 
in  the  following  paragraphs. 


1.2  ACOUSTICS  SIMULATION 

1.2.1  Targat  Simulation 

Targst  signals  contain  information  which  allowa  tha  skillad  oparator  to  claaaify  and  locata  him 
targat  of  intersit.  Those  signals  comprise  broad  band  noisa  and  aata  of  discrete  frsqusnoiss.  It  ia 
the  chareotariatioa  of  these  signals  which  allow  tha  oparator  to  determine  the  olaaalfloation  of  the 
targot  under  surveillance. 

complementary  to  these  targat  characteristics  era  other,  usually  mors  subjective,  audio  affects 
tha  presence,  and  in  some  cases  ths  absence,  of  which  aids  classification.  Typical  of  these  af facta  are 
cavitation,  angina  and  propallar  aaaociatad  noises.  These  audio  chareeteriatios  reflect  tha  appropriate 
changes  of  tha  simulated  targets'  manoeuvring  parameters. 


1.2.2  lavironsaatal  Simulation 

The  environmental  models  taka  into  aacount  audio  propagation  and  environmental  nolaa  characteristics 
-  dlffsrsnt  mods it  are  used  depending  upon  tha  particular  type  of  sonobuoy  in  use. 


1.2.3  Sonobuoy  Simulation 

Targat  and  audio  signal*  are  processed  in  accordance  with  ths  characteristics  of  tha  sonobuoy 
being  monitored.  The  signal*  era  modified  to  taka  into  aacount  ipsolfio  sonobuoy  chareotariatioa  auoh  a* 
hydrophone  frequency  response,  beam  forming  capabilities  and  ao  on. 


1.2.4  Raoalvar  -  Transmitter  Simulation 

This  rapraaanta  th*  final  ataga  of  ths  simulation  ohsin  and  comprises  tha  routaing  of  ths 
incoming  signals  to  ths  correct  aircraft  equipment.  Channel  and  tha  modelling  of  effnats  related  to  hf 
transmission /propagation  and  reception, 

1.3  RADAR  SIMULATION 

1.3.1  Target  Simulation 

Signals  comprising  video  signals  appropriate  to  tha  output  of  ths  radar  IF  detector  in  the 
dispersive  unit  are  fad  into  ths  avionics  system  for  presentation  and  display  to  ths  operator. 

Video  returns  ere  generated  to  represent  a  wide  variety  of  targst  types  including  aircraft, 
halicopters,  various  surf sea  vassals,  submarines  and  oil  rigs. 

The  generation  of  ths  correct  targst  responses  involves  the  calculation  of  the  respective 
signal  level  taking  into  account  syltain  variables  including  transmitter  power,  antenna  gain  and  polar 
diagrams,  transmitter  frequency,  electromagnetic  and  weather  attenuation  and  targat  scintillation.  The 
targst  responses  era  appropriate  to  ths  operator  display  mods  selection.  Secondary  targst  effects 
are  associated  with  targat-borns  secondary  radar  iff  and  I-band  transponder  replies.  In  ths  case  of 
IFF,  tha*#  coded  video  return*  contain  information  which  provide*  targat  statu*  data.  Additional 
targat-rslatad  affects  ere  simulated  such  as  th*  effect  on  ths  radar  of  targat-borns  electronic 
counter  measures* 


1.3.2  Environmental  Simulation 

The  sffsctn  on  tha  radar  of  such  environmental  reflectors  as  land  mass,  cloud  mass  and  eaa 
clutter  ar*  included,  tha  video  corresponding  to  land  and  cloud  returns  being  produced  using  flying 
spot  scanner  tschniqusi.  Thus  it  is  necessary  to  taka  into  account  ths  variation  of  video  returns 
with  a  large  nuabsr  of  variables  such  at  sea  stats,  wind,  transmission  polarisation,  aerial  tilt 
and  spacial,  temporal  and  frequency  correlation  characteristic*, 

1.3.3  Rsoeivnr  -  Treuemlttsi/Scannsr  Simulation 

Tha  operation  of  tha  primary  scanner  aerial,  transmitter  and  receiver  systems,  and  th* 
secondary  IFF  transmitt*r/raoeiv*r(  and  tha  1-band  interrogator,  ar*  entirely  [simulated. 

Operational  characteristics  of  the  transmitter/rscaivsr  end  scanner  serial  avionics  units 
(s.g,  transmitted  power,  polar  diagrams,  etc.)  ure  implemented  entirely  by  computer  software  and 
are  utilised  in  ths  target  and  environmental  program  modsla.  Tho  primary  radar  scanner  platform 
is  simulated  by  means  of  a  hardware  electronic  scanner  which,  under  control  of  ths  Simulator 
computer,  will  produce  ths  appropriat*  azimuth  position  indication  required  by  ths  avionics  radar 
procsssor. 
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2.  DERIVATION  AND  VERIFICATION  OF  THE  SYSTEM  MODELS 

2.1  GENERAL 

Whereaa  the  fir  at  part  of  this  paper  outlined  the  facilities  of  th*  Nimrod  HR  Mk.  2  which 
were  required  to  be  simulated  and  the  methods  which  have  been  utilised  to  achieve  this  aim,  the 
second  pari  describes  the  general  methodology  adopted  to  derive  the  models  required  to  meat  the 
objectives.  It  defines  the  initial  requirement  of  such  models,  relates  raaliem  with  training 
objective,  determines  the  need  for  flexibility  as  well  as  expandability  and  goes  to  some  depth  into 
the  implementation  and  verification  phases. 

Throughout  this  paper  the  term  'model1  ia  used  to  denote  the  total  system,  comprising  both 
hardware  and  aoftwara,  which  is  required  to  simulate  the  aircraft  avionios  systems,  in  reel  time 
in  accordance  with  a  training  saanario  as  specified  ana  controlled  by  the  instructors. 


2.2  DEFINITION  OF  REQUIREMENT 

The  first  question  to  bs  answered  is  the  apparently  simple  one  of  "what  is  it  that  we  are 
trying  to  simulate?"  If  this  question  is  ashed  of  the  eventual  user,  the  answer  is  a  simple  ona  - 
an  MR  Mk.  2  Nimrod.  This  to  him  fully  define*  th*  xaquiremant  evan  though,  at  the  time  at  which  the 
question  i*  aikad,  h#  has  no  clear  understanding  as  to  what  an  MR  Mk.  2  Nimrod  comprises  sine*, 
of  necessity,  th*  question  must  b»  asked  at  a  very  early  stage  in  th*  development  of  vhe  aircraft 
systems.  This  simple  statement  of  requirement  must  first  of  sll  be  translated  into  an  explicit  end 
quantitative  statement  of  that  requirement.  Thin  involves  not  only  a  definition  of  the  aircraft 
systems  but  alto  a  definition  of  the  training  requirements. 

The  definition  of  th*  aircraft  syatams  involve*  detailed  engineering  discussions  with  the 
prime  system  manufacturers.  At  this  stage  there  ia  usually  a  fair  amount  of  prim*  system  requirement 
design  data  available.  This  data,  however,  is  produced  to  define  how  th*  avionios  uyuteme  are  to  perform 
in  their  airborne  environment  and  is,  by  definition,  a  statement  of  design  intant  rather  then  design 
achisvamsnt.  Th*  two  are  sometimes  at  variance  and  it  is  oftsn  in  the  very  areas  of  this  variance  that 
significant  training  requirement  exists. 

Training  requirements  are  defined  in  conjunction  with  the  RAF  specialized  training  branches. 

With  these  organisations  such  questions  as  "how  is  the  simulator  to  be  used  in  it's  training  role?) 
what  are  the  relative  importances  attached  to  the  different  aspects  of  th*  training  requirements?, 
whst  is  the  role  of  th*  instructors  and  what  controls  do  thoy  require,/  how  many  and  what  types  of 
target  must  be  simulated?" ,  and  so  on,  are  discussed.  This  proceis  is  very  much  a  two  way  dialogue 
involving  cost  effectiveness  assessments. 

During  both  these  phases,  additions!  support  and  information  is  obtained  through  disoueuione 
with  the  appropriate  specialized  government  research  establishments,  these  are  the  organisations  which 
are  directly  Involved  with  the  development  of  the  prime  avionio  systems  and  which  are  also  concerned 
with  the  aolleotion  and  analynis  of  'targets  of  interest'  characteristic  data. 

Defining  th*  requirement*  is  thus  seen  as  a  process  of  collecting  e  vary  large  amount  of  data. 

Much  of  this  data  is  irrelevant  from  a  simulator  point  of  view  and  it  must  all  be  vary  oarsfully  analysed, 
filtered  and  condenaed  into  a  definitive  statement  of  the  requirement.  Thin  requirement,  in  th*  form  cf 
an  operational  requirement  specification f  is  agreed  with  the  end  user. 


2.3  MODEL  CHARACTERISTICS 

Having  produced  an  operational  requirement  specification,  th*  next  step  is  to  produce  an 
engineering  implementation  specification.  It  is  at  this  stage  that  the  proossa  of  th*  derivation  of  the 
system  models  begins.  Any  model  used  must  have  specific  characteristics  which  are  directly  related  to 
the  nature  of  the  simulator.  The  required  model  characteristic*  are  discussed  below. 


2.3.1  Realism 

Greet  car*  is  taken  in  the  simulator  to  achieve,  as  far  as  is  cost  affective,  a  totally  rselistic 
environment  for  the  trainees.  This  is  necessary  to  induce  the  appropriate  psychological  involvsment  in 
order  that  effective  training  transfer  can  taka  place.  Howsver,  this  realism,  like  beauty,  i*  only  ekin 
dsap  in  that,  provided  it  appears  as  the  real  aircraft  to  the  human  aensas,  it  i*  good  enough.  This  may 


2.3.1  Realism 

Great  car*  is  taken  in  the  simulator  to  achieve,  as  far  as  is  cost  affective,  a  totally  realistic 
environment  for  the  trainees,  'this  is  necessary  to  induce  the  appropriate  psychological  involvement  in 
order  that  affective  training  transfer  oan  take  place.  However,  thi*  realism,  like  beauty,  ia  only  akin 
deep  in  that,  provided  it  appear  ,  aa  the  real  aircraft  to  the  human  seneae,  it  is  good  enough.  This  may 
simplify  the  modelling  task  in  a  very  high  degree  of  sophistication  in  the  model,  such  as  might  b* 

required  for  predictive  modelling,  is  not  required.  However,  careful  attention  must  b*  paid  to  th* 
provision  of  such  unwanted  signals  as  noise  and  artif ret  since  thla  is  very  often  of  significance  from  a 
training  point  of  view. 
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2.3.2  Flexibility /Ixpandebilltj' 

The  requirement  for  a  highly  flexible  and  expandable  nodal  ia  a  result  of  a  number  of  factors. 

By  its  very  nature  the  training  simulator  ia  one  of  the  first  items  in  the  total  aircraft  development 
programme  to  be  requirod  in  service  and  yet  it  is  usually  the  last  to  be  specified.  The  implementation 
timescales  can  be  compressed  only  so  much  and  simulation  system  complexities  ere  now  euch  that  significant 
lasd  timas  ere  unavoidable.  Zn  these  time  frames  it  is  insvi table  that  significant  changes  to  ths 
aircraft  syetama  will  taka  place.  At  tha  comsiencament  of  eyetam  modelling,  it  ia  therefore  necessary  to 
attempt  to  predict  In  which  areas  thass  changes  are  likely  to  taka  place  and  build  in  a  flexibility  to 
tha  corresponding  modal. 

This  is  where  the  experience  of  both  the  simulator  manufacturer  and  the  prim*  equipment  manufacturer, 
can  be  pooled  to  good  effect. 

The  end  user  becomes  more  end  more  familiar  with  the  aircraft  ayatama,  this  being  an  inevitable 
learning  process  during  the  aircraft  development  phase.  Thus,  hie  initial  tentative  ideas  at  the 
commencement  of  the  operational  requirement  specification  may  significantly  change  as  a  result  of  this 
learning  process.  This  change  will  inevitably  influence  the  simulation  philosophy  and  consequently  the 
modelling.  A  similar  requirement  for  flexibility  arises  from  the  fact  that  all  simulators  after  a 
relatively  short  in-service  operation  require  a  fairly  extensive  modification. 

Many  of  the  effects  being  simulated  are  of  a  very  highly  eubjeotlve  nature,  for  example,  it  ia 
vary  often  difficult,  if  not  iipossibla,  to  define  in  a  quantitative  manner  such  effects  ea  target 
generated  audio  effects  on  acoustics  snd  processed  swe  clutter  affects  on  radar.  These  affect*  in  the 
early  stage*  can  be  defined  only  in  a  relatively  broad  manner.  It  i*  therefore  important  that,  from  the 
onset,  the  simulation  is  implemented'  in  such  a  way  that  a  large  number  of  adjustable  parameters  are  mads 
available.  In  this  wsy  the  system  can  ba  'tuned1  to  match  live  trials  data  as  it  becomss  available 
further  downstream  in  tha  aircraft  triala  programs*. 

By  thair  very  nature  there  la  often  a  significant  training  requirament  for  operating  equipmsnt  in 
possibly  rarely  encountered  environments.  For  sxampla,  it  could  be  very  important  to  train  an  operator  to 
interpret  essential  information  and  taka  appropriate  action  whan  the  system  is  performing  against  enemy 
transmitted  counter  measures.  Inevitably,  tha  axsot  performance  of  the  equipmsnt  in  such  an  environment 
is  often  ill  defined  -  ncoa  high  degree  of  prediction  being  required  at  the  modelling  stag*.  Thus  a  high 
degree  of  flexibility  in  required  for  subsequent  adjustment  of  the  system  to  metch  trial*  and  operational 
data  which  may  not  become  available  until  a  long  way  into  the  simulator  lifetime. 


2,3.3  General  Purposa 

Ths  feot  that  many  of  the  target  associated  characteristics  whloh  are  to  be  simulated  are  of  * 
very  highly  classified  nature,  influences  the  modal  used.  On*  of  tha  prim*  function*  of  the  acoustics 
syatam  is  targat  idantification.  This  idantification  ia  baasd  largaly  upon  racognition  of  the  frequenoy 
oharaotaristios  of  tha  targat  emittad  signals.  By  ths  subjactivs  nature  of  these  signals,  proficiency 
in  recognition  requires  continuous  and  repetitive  exercising.  Also,  by  thair  netura,  thass  sxaot 
fraqusney  contsnts  are  highly  olaaaiflsd.  To  circumvsnt  the  vequiremant  for  a  datailed  knowledge  of  ths 
exact  frequencies,  the  simulation  has  to  be  capable  of  generating  signals  taoh  characteristic  (for  example 
frequency,  amplitude)  of  which  ia  operable  within  broadly  defined  limits. 

The  user  in-aervica  specifies  ths  detailed  and  specific  parameters  which  define  particular  targets 
of  interest.  This  allows  him  continuously  to  update  hie  simulated  targets  throughout  the  operational  Ilf* 
of  the  simulator  and  tha  aircraft,  affective  training  can  consequently  be  carried  out  utilising  fully  up 
to  date  intelligence  sources. 


.2.3.4  Real  Tims  Operation 

that  tha  modal  must  ba  operated  in  real  time  nay  restrict  or  even  preclude  tha  use  of  tha  models 
with  whloh  the  prime  systems  have  been  developed  for  the  aircraft.  In  conjunction  with  the  expandability/ 
flexibility  requirement  this  very  often  dictates  the  hardware /software  modal  partitioning.  Thus,  required 
signal  data  rates  which  would  normally  suggest  ths  use  of  dedicated  hardware  may,  in  effect,  need  to  be 
implemented  by  eoftware  in  areas  where  a  future  high  degree  of  changeability  i*  anticipated. 


2.3.S  Predictive 

Little  operational  axperlena*  Is  available  until  the  aircraft  ia  fully  operational  and  that  ia  a 
long  way  downstream  as  far  as  tha  simulator  development  Is  concerned.  At  commencement  of  simulator  design 
It  is  necessary  to  extrapolate  from  known  characteristics,  based  on  existing  sensor  performance,  to 
possible  future  characteristics  baaed  upon  predicted  senunr  performance.  To  illustrate  this  there  is  e 
wealth  of  target  acouati.cs  signature  information  availabla  based  upon  existing  senobuoys  and  procasaing 
syutame.  New  sonobuoya  and  processing  systems  in  development  improve  tha  syatam  parameters,  thus  there  is 
an  extension  of  the  frequency  hand,  and  improvament  in  resolution  and  threshold  values.  It  is  necessary  to 
try  to  predict  how  known  target  characteristics  might  bs  changed  and  also  what  new  characteristics  might 
bscoms  apparent  as  a  result  of  the  ohangad  system  parameters. 

2.4  MODEL  IMPLEMENTATION  i 

Tha  requirement,  as  expressed  in  terns  of  an  operational  specification  and  a  eet  of  modal 
characteristics,  must  now  be  engineered.  It  is  at  this  stage  that  such  design  considerations  rogarding 
ths  extant  to  which  tha  avionics  is  to  bs  modelled  and  the  herdware/softwere  partitioning  are  answered. 

A*  far  as  ths  former  is  concerned  the  answer  is  very  largely  dictated  by  the  requirod  implementation 
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programme.  Thus  the  required  in-service  date  or  the  simulator  relative  to  the  aircraft  isvoses  a  tight 
simulator  development  timescale.  The  degree  of  complexity  of  the  avionics  systems  together  with  the  fact 
that  they  are  quite  often  subject  to  significant  and  rapid  changes  during  the  aircraft  development 
programme,  precludes  any  attempt  at  their  direct  simulation.  Thus  avionics  are  fitted  rather  than  being 
simulated, 

The  axaat  extant  to  which  tha  aircraft  systams  ars  fitted  to  the  simulator  and  at  which  point  in 
ths  aircraft  signal  procassing  chain  tha  simulation,  par  sa,  starts,  is  dacidad  largely  on  cost 
effectiveness  grounds.  Thus  both  this  acoustics  and  radar  simulations  produce  simulated  signals  corresponding 
to  receiver  outputs. 

Ths  hardware /software  partitioning  is  arrived  at,  taking  cost  considerations  into  account,  by  a 
balance  between  system  data  rates  and  flexibility.  Where  high  data  rate  might  normally  be  inplementad  by 
a  dedicated  hardwaru  it  may  ba  decided  to  implement  it  by  software  in  areas  where  a  high  probability  of 
future  change  is  predicted. 

Ths  simulation  might  be  based  on  information  which  is  either  theoretical,  empirical  or  a  mixture. 

Ths  empirical  sources  ars  used,  for  example,  to  ipsoify  target  acoustics  characteristics.  Ths  uss  of 
theoretical  sources  is  not  quits  so  straight  forward  or  productive  as  it  might  seem  at  first.  Tha  radar 
is  designed  primarily  for  operation  in  tha  maritime  role  and  ita  prime  processing  function  is  the 
elimination  of  sea  clutter  affects  in  aocordance  with  operator  selected  thresholds.  To  give  the  operator 
tha  oorreot  'feel'  it  is  essential  that  tha  simulator  provide!  truly  representative  sea  clutter  effects  to 
ths  radar  processing  system.  At  first  sight  ths  implementation  appaars  to  be  staple  -  uee  the  same  modal 
for  sea  clutter  which  was  ussd  for  the  specifications  and  devalopmant  of  tha  prime  equipment.  However, 
investigation!  show  that  aven  among  tha  experts  there  is  no  agreement  as  to  tha  details  of  this  model) 
it  would  appear  that  thera  is  no  suoh  thing  as  a  'universal  modal'  for  radar  sea  clutter.  One  is  again 
in  the  situation  of  requiring  to  uss  a  highly  flexible  model  basad  upon  tha  prime  model  but  whioh  can  be 
adjusted  at  a  future  data  to  meat  the  changes  required  to  match  airborne  performance. 


2.6.  MODEL  VERIFICATION 

An  sssential  part  of  tha  design  and  devalopmant  process  is  ths  sotual  modal  verification,  during 
whioh  procsss  there  is  a  continual  and  rapeatsd  reappraisal  of  the  following  fundamental  design  oritsrisi 

(1)  Is  tha  operational  raquiramant  being  met? 

(2)  Has  it  bean  correctly  engineered? 

As  far  as  the  first  question  is  concerned,  there  1b  a  continuously  changing  design  baseline. for 
tha  simulator  as  a  result  of  aircraft  development  and  user  experience.  The  seaond  queetion  elates  to 
establishing  whether  tha  hardware /software  models  have  been  engineered  correctly  to  meet  th  operational 
requirement. 

During  this  stage  tho  use  of  both  software  and  hardware,  prototypes,  is  invaluable.  There  is  often 
an  extensive  phase  of  actually  deriving  the  exact  software  model  during  which  a  whole  succession  of 
prototype  model*  may  be  evaluated  and  modified  or  even  completely  rejected  and  rewrittan.  This  evaluation 
process  involves  comparison  of  the  software  model  with  design  source  data  eithar  theoretically  or 
empirically  derived.  Prototype  hardware  is  also  built.  In  the  early  stages  this  is  evaluated  step  by  step, 
module  by  module  against  design  data.  As  this  evaluation  process  proceeds,  ths  prototype  is  gradually 
built  up  in  terms  of  complexity  and  size  aiming  towards  th*  final  total  configuration.  Eventually  the 
hardware  and  software  are  combined  to  form  a  total  system  and  the  evaluation  and  comparison  has  to  be 
against  live  data  rather  than  engineering  teat  data.  It  is  at  this  stage  that  tire  us*  of  the  actual 
avionics  ays terns  is  essential.  As  an  example,  tha  acoustics  avionicB  Bystem  is  dsslgnsd  to  procass 
signals  from  a  very  low  aignal-to-noiso  ratio  environment)  the  simulator  must  therefore  be  capable  of 
operating  at  corresponding  lsvels.  The  only  piece  of  test  squlpment  available  to  operate  at  such  levels 
is  the  avionics  rystom  itself,  Therefore,  in  this  stage,  the  avionics  equipments  are  used  as  a  eet  of, 
albeit  highly  specialised,  test  equipments  for  the  evaluation  of  the  simulation.  This  evaluation  is 
accomplished  by  comparing  ths  avionics  analysis  of  simulation  signals  with  the  avionics  analysis  of  actual 
signals  as  obtained  during  live  airborne  trials.  As  naosesary,  ths  software  and  hardware  are  'tweaked'  or 
modified  to  match  ths  trials  data.  It  is  at  this  stage  that  the  efficacy  with  whioh  the  flexibility/ 
expandability  of  the  modal  was  implemented  is  appreciated.  Through  this  iterative  procedure  the  design 
and  implementation  are  perfected, 

One  of  the  major  difficulties  in  this  verification  phase  is  associated  with  the  highly  subjective 
nature  of  many  of  the  simulated  systems.  While  there  may  be  little  of  a  subjective  nature  to  actuai 
trials  information,  and  It  is  possible  to  set  the  simulator  exactly  to  match  the  trials  data,  tha  data 
will  have  been  produced  for  a  limited  set  of  system  variables.  There  is  usually  neither  tha  money  nor 
the  time  available  to  trial  tha  eyetem  against  all  possible  combinations  of  system  parameters  and 
consequently  it  is  necessary  to  interpret  performance  between  the  trials  points  since  tho  simulator  must 
attempt  to  operate  within  all  combinations.  It  is  this  process  of  interpretation  which  can  ba  very 
subjective  and  makes  life  bo  often  difficult  for  the  simulator  designer.  In  the  final  analysis,  despite 
all  abjective  tools  used  in  the  Interim,  it  is  the  aseessor's  subjective  senses  which  apply  the  final 
acceptability  criteria. 
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3.  CONCLUSION 

It  might  ba  worthwhile  noting  one  area  of  spin-off  where  useful  lessons  might  be  learned  for 
future  such  programmes.  As  mentioned  earlier  in  this  paper,  the  actual  aircraft  system  is  used  as  a 
specialized  sat  of  test  equipment  for  the  evaluation  of  the  simulator  system.  Rtf lection  will  show  that 
this  is  the  exact  ravarsa  of  the  process  used  during  the  development  of  the  aircraft  system.  Thus  during 
the  development  of  the  prime  system,  there  is  a  need  for  a  signal  generator  (corresponding  to  the 
simulator)  for  uve  in  evaluating  the  performance  of  the  siroraft  system.  The  two  evaluation  processes  of 
airoraft  system  and  simulator  art  exactly  complementary  to  each  other.  This  has  been  borne  out  on  the 
Nimrod  programme  where  the  simulator  has  been  used  to  generate  known  and  controlled  signals  for  stimulation 
of  the  acoustics  systam  for  evaluation.  Usd  this  capability  bean  foreseen  at  a  sufficiently  early  stage 
in  the  aircraft  programs  the  apacific  requirements  for  the  aircraft  system  could  have  been  designed  into 
the  simulator  and  a  much  better  and  affective  tool  may  wall  have  resulted.  The  same  might  apply  in  the 
case  of  radar  for  evaluating  its  performance  against,  for  example,  j tamer a.  The  conclusion  then  is  that 
although  tha  benefits  of  early  consideration  of  the  simulator  in  the  overall  aircraft  prograamte  are 
beginning  to  become  apparent,  further  scrutiny  aight  reap  evan  more  fruitful  benefit. 
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APPLICATION  OF  COMPUTE R  SIMULATIONS  TO  DEVELOPMENT 
OF  NATO  E-3A  AUTOMATIC  TRACK  INITIATION  ALGORITHMS 
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SUMMARY 


The  NATO  E-3A  Airborne  Warning  and  Control  System  will  include  the  capability  to  initiate  tracks  automat¬ 
ically  on  target*  of  interest.  Due  to  the  complex  and  interacting  nature  of  the  automatic  track  initiation 
(ATI)  process,  development  of  a  prototype  ATI  design  must  rely  heavily  on  Monte  Carlo  computer  simulations. 
Adaptable  computer  simulations  were  developed  which  provide  the  analyst  with  a  versatile  tool  for  evalua¬ 
tion  of  ATI  design  alternatives  and  performance  sensitivities.  In  addition  to  aaaistlng  the  analyst  during 
design  development,  simulation  serves  the  necessary  function  of  augmenting  live  testing  by  providing 
assessments  of  system  performance  in  target  environments  which  are  difficult  or  impossible  to  reproduce  in 
live  flight  tests  or  in  typical  operational  exercises.  Although  the  computer  simulation  was  used  for  the 
E-3A  ATI  problem,  it  sleo  has  general  application  to  the  evaluation  of  overall  tracking  performance  for 
the  E-3A  or  for  any  track-while-scan  system. 

The  ATI  design  which  evolved  from  thie  development  effort  utllizee  a  Kalman  filter  for  track  smoothing  and 
prsdlctlon.  A  Kalman  filter  not  only  provide!  rapid  and  accurate  determination  of  target  position  and 
velocity,  but  also  provides  estimates  of  tracking  errors  which  can  be  used  to  advantage  in  the  design  of 
optimal  adaptlva  correlation  windows,  maneuver  detection  thresholds,  and  crack  promotion/drop  rules.  Sim¬ 
ulation  resulcs  have  shown  that  the  ATI  design  provides  excellent  performance  over  a  wide  range  (if  target 
condltiona  and  target  environments.  ; 

1 .  INTRODUCTION  1 

The  NATO  E-3A  automatic  track  initiation  (ATI)  function  must  operate  effectively  over  a  wide  tanpe  of  tar¬ 
get  environments  and  radar  modes.  The  effects  of  close  formations  of  targets,  maneuvering  targets,  crossing 
targets,  as  well  as  radar  performance  characteristics  on  ATI  performance  must  be  considered.  Tima,  multiple 
target  computer  simulations  were  devalopad  to  support  the  ATI  design  effort,  The  ATI  function  must  contend 
with  the  conflicting  requirements  of  initiating  tracks  quickly  on  real  targets  and  minimizing  thej  number  of 
false  track  initiations  induced  by  false  reports  or  by  radar  data  contention*  between  adjacent  tracks.  A 
good  balance  must  be  achieved  between  these  measures  of  performance  to  insure  that  the  ATI  function  provide* 
effective  aaaistance  to  E-3A  operators.  This  paper  describe!)  the  simulation  model*  employed  in  tile  develop¬ 
ment  effort,  the  ATI  design  which  evolved  from  this  effort,  and  also  presentB  a  sampling  of  the  performance 
characteristics  of  the  prototype  design. 

The  computer  simulation  contains  all  the  element*  necessary  to  permit  a  thorough  evaluation  of  prototype 
ATI  designs,  The  simulation  includes  target  and  E-3A  flight  path  generatori,  radar  target  detection  models, 
radar  false  reports,  radar  meaauramont  error*,  track  correlation  logics,  priority  rules  for  resolving  track 
correlation  conflicts,  track  smoothing  logics,  maneuver  detection  logics,  maneuver  response  logics,  and 
track  promotion/drop  logics,  A  complete  act  of  adaptable  parameters  arc  included  to  permit  evaluation  of 
ATI  design  alternatives  and  perform.moe  sensitivities.  Extensive  data  reduction  routines  provide  compre¬ 
hensive  summaries  of  pertinent  aspects  of  track  initiation  and  tracking  performance. 

To  maximize  the  effectiveness  of  the  ATI  design  in  a  dense  target  envi ronmap t ,  correlation  windows  must  bo 
small  enough  to  minimize  cross-correlations  between  adjacent  targets,  yet  large  enough  to  provide  a  higki 
probability  of  correlating  target  reports  when  available.  In  this  type  of  environment,  adjacent  target  > 
correlation  windows  will  frequently  overlap,  thus  it  is  important  to  devolop  optimally  shaped  correlation 
windows  augmented  by  meaningful  priority  rules  for  resolving  correlation  conflicts.  The  Kalman  filter  ' 
variances  are  used  to  advantage  in  sizing  efficient  adaptive  correlation  windows,  and  these  correlation  \ 
window*  are  further  refined  to  take  full  advantage  of  the  fact  that  the  E-3A  radar  provides  very  accurate  , 
estimates  of  target- range  and  range  rate  (in  some  radar  modes).  An  automatic  track  drop  logic  has  been 
developed  which  makes  use  of  the  maximum  dimension  of  the  correlation  window  and  thus  adapts  automatically  • 
to  individual  hlt/miss  patterns,  target  range,  target,  report  type,  and  operator  entered  apeed/heading  limits'. 
,hia  track  drop  logic  offers  a  distinct  advantage  over  conventional  logics  baaed  solely  on  rigid  hit/mlss 
thresholds. 

2.  ATI  SIMULATION  MODEL 

The  computer  simulation  developed  to  support  the  ATI  study  provides  a  general  tool  for  evaluating  varioua 
tracking  features  of  track-while-scan  eystemB.  The  modulur  program  design  provides  the  analyst  with. the 
option  to  select  and  tailor  program  elements  appropriate  to  the  problem  being  studied.  The  eimulation 
model  employs  Monte  Carlo  techniques  to  generate  scan-by-scan  simulated  radar  reports  based  on  true  target 
positions  and  radar  performance  parameters.  These  simulated  radar  reports  are  then  passed  to  the  tracker 
model  which  processes  the  reports  to  produce  corresponding  system  tracks.  Detailed  track  histories  and 
events  of  interest  arc  then  recorded  for  evaluation.  Recorded  data  1b  available  to  the  analyst  in  a  variety 
of  output  options  including  summery  statistics  find  graphic  representations  as  required  to  satisfy  the  objec¬ 
tives  of  thu  particular  study. 

the  simulation  was  developed  using  FORTRAN  IV  source  code  which  was  compiled  and  executed  on  an  IBM  operating 
system.  Graphic  capabilities  cere  provided  by  a  Zeta  plotting  system;  however,  the  plotting  program  elements 
are  also  compatible  with  other  plotting  equipment. 

2.1  Computational  Support 

The  simulation  model  was  developed  and  utilized  with  an  IBM  370/3031  operating  system.  The  basic  computer 
provides  6  million  bytes  of  storage  and  is  interfaced  with  a  complete  set  of  peripheral  device*  including 
card  reader,  high  speed  printers,  tape  drivea,  an  extensive  direct  access  storage  subsystem  Eor  the  on-line 
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storage  of  data,  and  display  terminals  allowing  on-line  access  to  tie  operating  system.  The  entire  system 
operates  under  the  control  of  IBM's  Multiple  Virtual  Storage  (MVS)  operating  system  and  can  execute  1.2 
mil  Lion  instructions  per  second. 

A  time  sharing  option  that  allows  the  user  to  Interactively  access  the  operating  system  with  an  IBM  32 78 
display  was  used  extensively  during  tho  ATI  study.  During  the  model  development  [base,  program  elements 
were  composed,  edited)  compiled)  executed  and  debugged  entirely  on-line  uelng  the  time  -hating  option. 

After  development,  program  load  modules  and  data  sets  were  retained  on  dish  storage.  Simulation  production 
runs  were  submitted  for  economical  batch  execution  using  the  time  sharing  option . 

The  date  available  from  the  simulation  model  can  be  directed  to  a  high  spued  printer  for  hardcopy  end  to  a 
magnetic  tape  aubsyutem.  The  data  contained  on  a  magnetic  tape  can  be  plotted  u»ln$  the  Zeta  6000  Plotting 
System  to  plctorially  represent  simulation  results  in  a. clear  and  concise  manner.  The  Zeta  system  is  an 
off-line  unit  which  operate*  independently  of  the  central  computer.  The  system  includes  a  16  inch  Incre¬ 
mented  drum  plotter  that  operates  at  speeds  up  to  4000  increments  per  second  with  an  Incremented  Site  of 
.0025  Inches. 

2.2  Key  Modal  Components 

The  key  elements  of  the  ATI  simulation  are  tho  scenario  model,  the  radar  model  and  the  tracker  mode)  which 
generate  the  true  target  positions,  the  simulated  radar  reports  and  the  track  dots,  respectively.  Figure  1 
ahowB  the  relationship  between  these  models  and  the  data  analysis  routines  Included  in  the  computer  simula¬ 
tion.  Execution  of  the  ATI  simulation  program  may  be  initiated  by  Inputs  to  the  scenario  model  or  by  e 
tape  input  to  a  lower  level  modal.  The  Input  tapes  In  the  latter  option  are  obtained  by  recording  options 
which  can  save  the  outputs  of  any  of  the  component  models  for  subsequent  use.  For  frequently  used  scenarios 
or  combinations  of  scenarios  and  radar  parameters,  this  option  permits  more  efficient  use  of  computer 
resources. 


2.2.1  Scenario  Model 

Tho  scenario  model  generates  scan-to-ac.m  target  and  E-3A  positions  based  on  model  inputs  which  specify 
target  profiles.  A  typical  profile  that  was  used  to  support  the  ATI  Btudlee  Is  shown  In  Figure  2.  Targets 
arc  identified  in  the  model  by  a  unique  number  as  shown  In  the  figure.  The  scenario  model  generatee  true 
target  positions  in  range,  azimuth  and  range  rate  relative  to  the  I5-3A.  Target  maneuvers  In  speed  und/or 
heading  are  modelled  In  accordance  with  model  Inputs,  although  the  U-3A  is  assumed  to  fly  a  racetrack 
pattern,  the  model  inputs  are  general  enough  to  permit  a  wide  range  of  flight  paths,  Including  circular 
orbits  and  constant  velocity  flight  patterns, 

2.2.2  Radar  Model 

The  radar  model  uses  the  data  provided  by  the  ucenario  model  to  guneratu  simulated  radar  detections  on  rasl 
targeta  and  false  reports.  Tho  simulation  includes  two  rada.-  modelsi  a  constant  detection  probability  (Pd) 
model  and  a  range  dependent  Pd  model.  Tho  constant  I’d  model  is  generally  used  for  maritime  targets  and  the 
range  dependent  Pd  model  Is  used  for  air  targets. 

Tho  range  dependent  model  used  In  tho  simulation  in  shown  in  Figure  3.  The  curve  is  approximated  in  the 
simulation  by  selected  points  and  interpolation  between  adjacent  points  Is  performed  to  determine  Pd  ut  any 
range.  The  target  range  has  befell  normalised  by  the  range  corresponding  to  a  detection  probability  of  .32 
which  corresponds  to  a  cumulative  probability  of  ,  DO  of  detecting  the  target  within  6  scans  (1  minute  In 
tho  case  of  the  E-'JA).  The  curve  is  baaed  on  theoretical  conalderatlona  and  it  adequately  represents  the 
actual  range  dependency  of  any  radar  for  n  constant  cross-section  target.  Various  target  sizes  can  be 
readily  simulated  simply  by  changing  the  range  normalization  value. 

Radar  measurement  errors  are  modelled  na  Gaussian  distributed  errors  In  range,  azimuth,  and  range  rate  (If 
available).  The  ijiean  and  standard  deviation  of  each  of  these  errors  arc  simulation  inputs.  Tile  standard 
deviations  aro  Intended  to  represent  the  total  composite  random  error  ill  that  particular  measurement.  The 
radar,  of  course,  Is  the  major  contributor  to  these  composite  errors.  For  purposes  of  this  study,  E-3A 
bias  errors  (primarily  navigation  errors)  are  not  modelled  because  they  vary  slowly  with  time  mid  thus  have 
no  effect  on  ATI  or  tracking  performance. 

Simulated  radar  reports  nro  gonornted  using  Monte  Carlo  techniques  to  determine  if  a  target  is  detected  snd 
to  determine  the  magnitude  of  the  error  In  each  of  the  radar  measurements,  independent  random  number  gen¬ 
erators  are  used  for  measurement  errors  and  are  activated  oven  if  it  linn  been  determined  that  the  target 
was  not  detected  during  that  scan,  by  utilizing  random  number  generators  !n  this  manner,  analyses  of  per¬ 
formance  sensitivities  to  various  parameters  are  more  meaningful,  and  can  generally  be  accomplished  with 
significantly  loss  Monte  Carlo  trials, 

Tho  radar  model  also  includeu  a  routine  for  generat  ing  false  reports  which  are  assumed  to  be  uni  farmly  dis¬ 
tributed  throughout  the  surveillance  nroa.  For  purposes  of  the  study,  it  is  only  necessary  to  model  false 
reports  In  a  relatively  small  square  area  which  1b  large  enough  to  include  the  real  targetu.  The  number  of 
false  reports  within  such  an  area  during  a  particular  scan  is  described  by  a  Poisson  distribution.  Thus, 
the  number  of  I'alao  reports  to  be  generated  tN)  can  lie  calculated  by: 


where,  i  -  average  number  of  raise  reports  in  ihu  square  nroa,  i.e.,  the  false  report  rate  multiplied  by 
the  ratio  of  the  square  area  to  the  surveillance  area. 

RN  "  random  number  draw  In  the  Interval  (0,  1) 
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If  falsa  reports  are  present  during  a  given  scan,  the  positions  of  these  falsa  reports  ere  determined  by 
two  random  number  draws  In  X  and  Y  coordinates  relative  to  a  comer  of  the  square.  If  the  report  Is  to 
simulate  the  radar  pulse  doppler  mode,  a  range  rate  value  la  also  generated.  The  range  rate  value  Is 
assumed  to  be  Gaussian  distributed. 

2.2.3  Tracker  Model 

The  tracker  model  uaaa  the  scan-to-acan  simulated  radar  detections  provided  by  the  radar  modal  as  inputs 
to  the  tracking  process.  This  model  Includes  all  the  elements  necessary  to  Initiate  tracks  automatically 
and  to  perform  all  the  functions  inherent  in  the  tracking  process.  Ml  the  component  features  of  the 
tracker  model  ere  described  in  paragraph  3. 

The  tracker  model  employs  a  variaty  of  modal  Inputs  which  control  correlation  window  sixes  and  ATI  promo* 
tion/drop  criteria.  The  basic  tracker  functions  of  track  Initiation,  Kalman  filter  Initialisation,  track 
correlation,  resolution  of  target  report  contentions,  end  track  smoothing  art  modelled  by  independent 
routine*.  Thus  the  tracker  model  can  be  readily  reconfigured  to  evaluate  alternative  designs. 

2.3  Simulation  Modal  Inputs 

Modal  inputs  are  used  to  tailor  the  simulation  modal  to  the  problem  being  studied  and  to  provide  control 
over  key  parameters  used  for  performance  sensitivity  analyses.  These  Inputs  arc  stored  on  disk  in  a  fils 
that  can  ba  adltad  on- lint  prior  to  submitting  a  computer  run.  Some  of  the  basic  input*  to  the  simulation 
modal  are  listed  below! 

Control  Inputs 

NMCR  -  number  of  Monts  Carlo  trials 

UMAX  -  number  of  radar  scans  to  be  simulated  during  each  Monte  Carlo  trial 

NSKP  ■  flag  uaed  to  control  output  options 

MODE  -  flag  used  to  control  radar  mode  simulated 


-  E-3A  racetrack  parameters  and  E-3A  spaed  and  heading 
■  initial  target  position  (X  and  Y  coordinates)  ' 

•  target  spued  and  heading  at  the  start  of  each  new  leg 

•  acceleration  value  used  for  each  target  maneuver  and  start  time  for 
tha  maneuver 

-  number  of  real  targets  in  the  scenario 


•  single  scan  probability  of  detection  for  the  constant  Pd  radar  modal 

•  tabla  entries  for  rang*  dependent  Fd  radar  model 

•  normalization  range  for  range  dependent  radar  modal 

■  radar  measurement  error  variance*  In  range,  asimuth  end  range  rate,  respectively 

•  false  report  rate  per  scan 

•  dlmanslon  of  square  area  within  which  raise  reports  ere  generated 

■  position,  speed  and  heading  of  the  canter  of  F  ARB  OX 


Scenario  Model  Parameter* 

LENGTH,  RADIUS,  VA, 
XTO,  YTO 
VT(I) ,  HT(I) 

ACCEL (X) ,  TIME(I) 

NTGT 

Sensor  Model  Parameters 

PDO 

PD(1) 

RO 

S1GR,  SIGAZ,  STGRD 

FAR 

FARBOX 

XO,  YO,  VB,  HB 
Tracker  Model  Parameters 


CM(T) 

DRD 
VI,  V2 
HI,  112 
N2 

N1 

RMAX 

RMAXP 


various  multipliers  uaed  to  elzo  range,  nxltnuth  and  rangs  rata  correlation  windows  for 

potantlul,  tentative  and  established  tracks 

potantlal  track  correlation  window  for  range  rate 

aeeumed  track  speed  limits  entered  by  E-3A  operator 

assumed  track  heading  limits  entered  hy  E-3A  operators 

number  of  acane  without  a  correlation  before  a  potential  or  tentative  track  la  automatically 
dropped 

number  of  correlations  required  to  promote  a  tentative  track  to  an  established  track 
maximum  radius  allowed  for  the  correlation  window  before  a  tentative  track  la  dropped 
same  as  above  for  potential  tracku 


2. A  ATI  Model  Outputs 


ATI  model  outputs  are  provided  by  high  speed  printing  or  off-line  plotting  equipment.  Prin  out*  include  scan- 
to-sr.an  data  and  event  histories,  track  summarise,  and  ATI  performance  atailotlca.  The  type  of  printed  output 
desired  is  specified  at  the  time  of  program  execution  by  appropriate  input  control  parameter*,  Four  typa*  of 
printed  output  are  available  and  examples  of  each  are  presented  in  Figures  4*7.  An  example  of  the  plotted 
output  available  le  shown  in  Figure  8,  These  examples  wore  generated  during  a  100  scan  simulation  run  ualng 
the  20  target  geometry  depicted  in  Figure  2,  target  speeds  of  500  knots,  and  the  range  dependent  probability 
of  detection  radar  model. 


For  each  Monte  Carlo  run,  the  date  shown  in  Figure  a  is  availablt  for  every  simulated  radar  rcan.  Tht  data 
la  divided  Into  two  basic  sectional  n  target  data  summary  and  a  track  statue  aummaty,  Tha  target  data 
summary  includes  the  actual  targeL  X  and  Y  coordinates  and  the  radar  reported  targut  coordinates  in  X,  Y, 
and  R,  An  entry  of  aero  for  a  target  radar  report  indicates  that  the  target  was  not  detected  during  that 
■can.  Reul  targets  are  numbered  sequentially  (1  through  20  In  this  example)  and  this  number  le  retained  aa 
a  unique  identifier  for  tha  target.  False  reports  (If  any)  generated  by  the  radar  nr»  printed  out  imme¬ 
diately  below  the  true  target  reports  (target  number  21  in  Figure  4), 


The  track  etatue  aumnary  la  the  eacond  baalc  aectlon  In  Figure  4.  The  flrat  printed  line  bealde  the  title 
provldaa  a  summary  count  of  tracks  In  potential,  tentative,  established,  or  drop  etatue.  Data  la  shown  for 
each  track  currently  in  the  system  ordered  by  track  number.  Track  numbers  a-s  assigned  sequentially,  starting 
with  one,  aa  each  new  track  is  Initiated.  Track  data  in  this  aumnary  includes  the  initiation  status  of  the 
track  (P  *  potential,  T  «  tantatlve,  E  »  established,  D  •  dropped),  the  target  number  of  the  report  used  to 
update  the  track  during  tha  currant  scan,  and  the  target  number  of  the  report  which  vaa  pravioualy  usad  to 
update  tha  track.  An  antry  of  earc  in  column  2  indicates  that  a  target  report  did  not  correlate  with  the 
track  that  scan,  while  an  antry  of  99  indicates  that  tha  track  has  Just  bean  automatically  dropped.  These 
entries  era  followed  by  tracking  errors  in  position  (X  component,  Y  component,  total  position  error),  speed, 
and  heading.  The  predicted  tenga,  azimuth  and  range  rate  of  tha  track  fare  printed  out  in  tha  next  three 
column.  If  a  report  correlated  with  «  particular  track  during  the  currant  scan,  its  range,  aalmuth,  and 
range  Tate  are  printed  nut  In  tha  nuxt  threw  columns.  The  remaining  entries  Include  tha  range,  aalmuth, 
and  range  rate  correlation  window  alaes,  the  X  and  Y  position  of  the  predicted  track,  and  X  and  Y  measure¬ 
ment  residuals.  The  measurement  residuals  are  tha  differences  between  the  reported  target  position  and  the 
predicted  track  position. 

In  the  example  shown  In  Figure  4,  track  number  9  hen  just  been  promoted  to  established  statue.  It  should  ba 
noted  that  lta  currant  correlation  was  with  target  number  14  and  lta  prevloue  correlation  wee  with  target 
number  13,  Thie  is  an  axampla  of  a  false  track  resulting  from  rroea-correlationa  in  the  tentative  phnee, 
Typically,  such  a  track  has  a  relatively  large  speed  and  heading  error,  nnd  fails  to  correlate  consistently 
with  any  target  after  tha  cross-correlation  has  occurred. 

Figure  5  is  '  'xample  of  a  printout  which  provides  a  cross  reference  of  target  and  track  numbers  on  a  scan- 
to-ecan  basis.  This  printout  is  provided  for  each  Monte  Carlo  run.  The  flrnt  column  of  the  printout  la  the 
scan  number  associated  with  each  row  of  data.  Columns  2  through  21  correspond  to  target  numbers  1  through  20, 
respectively,  nnd  columns  22  through  26  are  for  false  reports.  The  number  entry  appealing  in  a  target  report 
column  corresponds  to  the  number  of  the  track  which  was  updated  by  that  particular  target  during  the  currant 
scan.  An  entry  of  zero  indicates  that  the  target  was  not  detected  during  that  scan.  The  matrix  representation 
shown  in  this  figure  is  especially  useful  because  the  analyst  can  quickly  determine  how  soon  a  track  la  initi¬ 
ated  on  a  target  nnd  how  wall  the  target  is  being  tracked.  In  addition,  falee  tracks  resulting  from  cross- 
correlations  between  turgete  can  be  easily  identified.  The  example  shown  in  Figure  5  shows  two  such  false 
trucks,  namely  track  numbers  2  and  8.  Track  number  8  was  promoted  to  an  esttabliehed  track  during  scan  6  after 
correlating  on  reports  from  target  numbers  12,  13,  end  14;  and  track  numbor  2  was  promoted  during  scan  7  after 
correlating  on  reporta  from  target  numbers  1  and  2, 

Scan-to-scnn  histories  of  each  track  for  each  Monte  Carlo  run  are  also  available  to  the  analyst.  As  an  exempli, 
the  history  for  track  number  2  (i  a.,  the  falsa  track  diacusied  in  the  previous  paragraph)  is  shown  in  Flgure.6, 
The  track  data  is  ordered  according  to  scan  number  (shown  in  column  1)  commencing  with  the  seen  number  when  tha 
track  was  initiated  as  a  potential  track.  Column  number  2  indicated  the  current  initiation  status  of  tha  track 
and  column  3  gives  tha  number  of  the  target  which  hae  updated  the  track,  A  zero  entry  In  column  3  indicates 
that  the  track  was  not  updated  that  scan.  The  remaining  information  in  this  printout  io  a  subset  of  the  date 
shown  in  the  track  status  summary  section  of  Figure  4. 

Figure  6  showe  that  a  potential  track  wae  initiated  on  target  2  during  scan  1.  The  track  was  promoted  to  ten¬ 
tative  atatus  during  acan  2  based  on  n  correlation  from  target  2,  Tha  next  correlation  (aean  3)  was  also  from 
target  2  but  the  following  correlation  at  scan  7  which  resulted  in  promotion  to  established  statue  wue  from 
the  adjacent  target  number  1.  The  reanon  for  the  cross-correlation  is  that  thu  speed  and  heading  arrore  ere 
rather  large,  duo  primarily  to  unusually  noisy  radar  measurement*  in  the  first  two  reports.  The  large  spaed 
and  heading  errors  eventually  cause  the  track  to  lose  correlation  on  Its  own  target  and  move  close  enough  to 
the  adjacent  target  to  result  in  a  cross-correlation. 

Summary  atatlstlce  aa  shown  in  Figure  7  are  available  for  each  Monte  Curio  run.  This  summary  includes  the 
number  of  false  tracks,  the  number  of  lost  tracks  (l.e.,  established  tracks  which  are  no  longer  being  updated 
by  thu  target  which  Initiated  the  track),  plus  pertinent  information  on  the  valid  tracks  initiated  by  the  ATI 
function.  Suramury  statistics  identical  to  the  Figure  7  format  are  nlao  provided  for  the  composite  set  of 
Monte  Carlo  runs. 

The  track  date  generated  from  a  multiple  target  simulation  is  sometimes  difficult  to  visualize  from  printed 
outputs  alone.  Consequently,  a  routine  was  developed  to  provide  the  capability  to  plot  tracks  and  radar 
report*.  The  output  from  the  tracker  model  aaved  on  magnetic  tape  includes  all  the  track  and  report  data 
required  aa  Input  to  generate  a  plot.  Hie  plot  routine  requires  additional  input  parameters  to  control  the 
acule  of  the  plot,  to  select  the  scan  of  interest,  and  to  select  the  tracks  for  which  correlation  historlss 
are  desired  along  with  the  number  of  Deans  desired  in  this  correlation  history.  An  example  of  a  plot  gen¬ 
erated  uring  this  capability  it  shown  in  Figura  8. 

All  trncka  depicted  in  Figure  8  are  tagged  with  their  respective  track  numbers  for  easy  identification.  Tha 
initiation  status  of  each  track  is  given  following  the  track  number  (P  ■  potential,  T  -  tentative,  E  ■  estab¬ 
lished,  0  “  dropped).  Individual  radar  reporta  correlating  with  selected  tracks  during 'the  seven  previous 
scans  may  also  be  plotted.  Figure  8  depicts  the  report  histories  for  the  two  false  tracks  (numbers  2  and  8). 
These  repoi  a  are  connected  by  broken  linos  and  labelled  with  the  target  number  which  they  represent.  The 
target  numbera  are  subscripted  with  the  scan  number  during  which  the  target  wna  detected.  The  vectora  shown 
aa  solid  lines  originating  from  each  track  position  indicate  the  track  velocity.  The  magnitude  of  the  vector 
is  scaled  to  the  track  speed  and  the  direction  of  the  vector  indicates  the  track  heading. 

2.5  Timing  and  Sizing  Estimates 

Thu  simulation  model  which  wea  generally  used  during  thu  ATI  studies  had  n  20  target  capacity,  although  a  100 
target  capacity  model  was  also  used  to  some  extent.  The  20  target  simulation  model  required  120,000  bytes  of 
storage  on  the  tHM  370/3031  computer  (8  hits/hyte)  while  the  100  target  model  required  150,000  byteu  of 
storage . 
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Th"  execution  tin*  for  an  ATI  simulation  run  is  a  function  of  obvious  parsmatars  such  as  number  of  targets, 
number  of  scans,  and  ths  number  of  Monts  Carlo  runs.  Execution  time  varlas  linearly  with  these  parameters. 
However,  the  selected  printout  option  slso  has  significant  impact  on  execution  time.  Table  1  presents  the 
execution  time  for  thu  three  available  options  (which  are  various  combinations  of  the  printout  examples 
shown  in  figure  A  through  7).  The  times  shown  in  th*  table  correspond  to  a  20  target  scenario,  100  scans, 
and  10  Monts  Carlo  runs.  Printout  option  A  includes  ths  track/targst  correlation  matrix  shown  in  Figure  5 
plus  ths  summary  statistics  shown  in  Figure  7,  Option  A  produces  2  pages  of  printout  per  Monte  Carlo  run, 

This  printout  option  is  usually  sufficient  to  evaluate  performance  of  a  mature  ATI  design.  During  the 
development  phass  of  an  ATI  design,  however,  more  extensive  data  outputs  ars  often  required  and  printout 
options  B  and  C  are  aval  ible  to  assist  the  analyst.  Printout  option  B  Includes  ths  output  of  option  A 
plus  the  scan-to-scsn  ot  and  track  euanarlea  shown  In  Figure  A.  Option  B  produce*  102  page*  of  print¬ 
out  par  Monts  Carlo  run.  cintout  option  C  provides  ths  output  of  option  B  plus  ths  track  historis*  shown 
in  Flgurt  6.  Option  C  .  -ally  produce*  140  pages  of  printout  par  Monts  Carlo  run.  Ths  processing  tins 

associated  with  ths  scenario  medal  end  ths  radar  model  Is  less  than  5  seconds  for  ths  example  shown.  This 
is  attributed  to  ths  rathar  simple  20  target  acanario  considered.  Mors  complsx  scenarios  with  maneuvering 
targets  would  require  mors  processing  tima.  For  such  scenarios,  It  Is  worthwhile  to  usa  the  taps  recording 
options  for  acanario  model  or  radar  modal  outputs  end  save  this  processing  tins  during  subsequent  computer 
runs. 

TABLE  1 

TIMING  ESTIMATES 

Printout  Time 

Option  (Seconds) 

A  96 

B  260 

C  301 

3.  ATI  DESIGN 

The  ATI  design  employ*  three  dletinct  tracking  phases,  namely  potential,  tentative,  and  eetabllahcd,  A 
potential  track  la  formed  from  reports  which  do  not  correlate  with  tentative  or  established  tracks,  A  po¬ 
tential  track  la  promoted  to  tentative  statue  If  a  report  correlation  Is  achieved  within  t  certain  time 
period,  otherwise  the  truck  le  dropped,  Upon  promotion  to  tantstlve  an  Initial  track  velocity  can  bs  cal¬ 
culated  from  ths  ground  stabilised  position  coordinates  of  ths  target  report  pair.  The  tentative  track  is 
promoted  to  established  status  whan  eubaaquant  correlations  suggest  that  ths  track  probably  represents  an 
actual  target.  A  tantstlve  track  la  dropped  if  timely  report  correlations  srs  not  achieved.  A  Kalman 
filter  la  employed  for  track  smoothing  end  to  assist  In  siting  efficient  correlation  windows. 

All  pertinent  algorithms  and  logics  characterising  ths  ATI  funotion  of  ths  E-3A  ttaakar  are  described  in 
thle  section.  A  flowchart  has  been  Included  in  Figure  9  to  assist  ths  reader  In  understanding  the  overall 
structure  of  ths  integrated  ATI/tracker  design. 

3.1  E-3A  Radar  Operating  Modua 

The  E-3A  detects  air  and  maritime  target*  In  a  variety  of  modes)  namely,  radar  eir  mode,  radar  maritime 
mode,  and  IFF.  The  radar  clr  mode  produces  two  different  types  of  reports,  pules  doppler  (PD)  report*  end 
b*yond-th*-horl*on  (BTH)  leporte.  The  radar  PD  mode  le  th*  normal  E-3A  mode  which  provides  detections  on 
targets  out  to  the  limits  of  Its  detection  range,  Ths  PD  report  lncludo*  estimates  of  target  renge,  esimuth, 
end  range  rate.  The  redar  BTH  mode  augments  th*  E-3A  surveillance  volume  by  providing  detections  on  targets 
beyond  the  renge  of  the  PD  mode.  The  BTH  report  include*  estimates  of  target  range  and  atlmuth.  The  radar 
maritime  mode  provides  detections  on  maritime  target*  within  line-of-elght  of  th*  E-3A,  and  th*  report 
Include*  estimate*  of  target  range  and  aelmuth.  The  IFF  eeneor  (it*  antenna  mounted  back-to-back  with  radar 
antanna)  provide*  aatlmate*  of  target  range  and  aelmuth,  along  with  th*  associated  IFF  modes  and  code*  on 
all  transponder  equipped  eir  and  maritime  target*  in  the  E-3A  surveillance  volume.  Automatic  initiation  of 
urgete  detected  by  IFF  1*  considerably  sailer  then  for  radar  target*  *lnce  IFF  report*  includ*  mod*  and 
code  identifying  Information  which  can  be  used  to  advantage  in  discriminating  between  nearby  target*.  Thus, 
the  primary  emphaala  of  thia  paper  la  ATI  processing  of  rnriar  reports. 

It  is  advantageous  to  totally  segregate  the  sir  and  maritime  ATI  functions,  This  pravent*  unnecsstary 
degradation  In  ATI  performance  due  to  targets  or  false  report*  of  th*  opposite  type,  Unique  identifier  bit* 
in  the  target  report  word  are  uaad  to  lalntain  this  legragttion.  These  Identifiers  are  also  used  to  key 
other  uniqu*  processing  features  In  the  ATI  design. 

3.2  ATI  Track  Phaiea  and  Promotion  Rules 

The  ATI  function  employs  two  intermediate  track  categories  (potential  and  tentative)  enrouta  to  establishing 
n  new  system  track.  Potential  tracks  are  Initiated  on  candidate  sensor  reports  located  in  operator  defined 
ATI  arena  which  do  not  correlate  with  tentative  or  established  tracks.  Candidate  reports  ere  determined  by 
the  type(e)  of  reports  selected  by  the  E-3A  operator  for  the  particular  ATI  area,  i.e.,  radar  (air  mods), 
radar  (maritime  mode),  and/or  IFF. 

A  potential  track  1*  Initiated  at  the  location  of  the  target  report  with  taro  apeod.  If  the  report  1*  a  mari¬ 
time  target  detection,  the  maritime  Kalman  filter  le  initialised  and  normal  Kalman  smoothing  commences  with 
the  next  correlation.  If  the  report  is  an  air  target  detection,  Initialisation  of  the  eir  tracker  Is  dslaysd 
until  the  next  correlation  when  a  velocity  can  ba  calculated. 

If  a  report  correlatea  with  a  potential  track  during  a  aubeequent  acan,  tha  track  le  promoted  to  tentative 
status.  For  alt  targets,  the  tentetive  track  is  initiated  ut  the  position  of  th*  current  report  with  a 
velocity  calculated  from  the  two  report*  now  available  on  the  target  and  the  elapsed  time  batwaen  reports. 

The  nir  tracker  la  tnltiolixed  and  normal  Kalman  smoothing  commence*  with  the  next  correlation. 
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Tentative  tracks  art  prone  tad  £o  established  atatui  if  N1  raporta  corralata  with  and  are  usad  to  smooth  the 
tentative  track,  and  If  track  speed  end  heading  (apaed  only  for  maritime  tracks)  fall  within  operator 
entered  llmlte.  For  maritime  targeta  and  for  air  targets  detected  in  the  radar  PD  mode,  a  value  of  two  (2) 
has  been  used  for  HI.  For  air  targets  in  the  radar  BTH  mode,  a  value  of  three  (3)  is  used  for  Nl.  The  N1 
correlations  oust  be  achieved  in  a  timely  meaner  otherwise  the  track  is  dropped  automatically.  Track  drop 
rulat  for  tentativa  tracks  ara  discussed  in  paragraph  3.6.  While  in  the  tentative  phase  (also  for  the 
potential  phase  of  maritime  tracks),  track  smoothing  and  prediction  logics  are  the  same  as  those  used  for 
established  tracks,  but  the  correlation  logic  (described  In  paragraph  3,3  and  3,4)  is  somewhat  different. 

3.3  Correlation  of  Target  Reports  with  Air  Tracks 

The  development  of  effective  correlation  teats  for  potential  air  tracks  is  difficult  because  there  Is  no 
velocity  estimate  available  until  a  pairing  la  achieved,  The  simplest  correlation  window  which  could  be  used 
for  potential  tracks  is  a  circular  window  cantered  at  the  track  poaition  with  a  radius  determined  by  the  max¬ 
imum  possible  target  spaed  plus  an  allowance  for  measurement  arrora.  Such  a  window  could  ba  quite  large  end 
thus  require  unnecessarily  stringent  track  promotion/drop  rules  to  minimise  the  number  of  false  tracks.  More 
effective  correlation  tastn  can  ba  devlaad  by  taking  advantage  of  operator  entered  target  spaad/headlng  limits, 
and  targat  report  range  rata  (if  the  target  la  detected  in  the  radar  PD  mode).  The  use  of  target  spaad/headlng 
limits  In  shaping  position  correlation  windows  la  discussed  In  paragraph  3.3.1  and  the  use  of  target  range  rate 
for  further  correlation  tasting  la  discussed  in  paragraph  3.3.2.  For  tentativa  air  tracks,  the  correlation 
window  design  takea  advantage  of  the  fact  that  radar  measurements  of  target  range  are  very  accurate  in  compari¬ 
son  to  the  aslmuthal  measurement  and  also  makes  uaa  of  range  rate  If  available.  Correlation  windows  for  ten¬ 
tative  air  tracks  are  discussed  In  paragraph  3.3,3. 

3.3.1  Position  Correlation  Window*  for  Potential  Air  Tracks 

Tha  position  correlation  window  used  for  potential  air  tracks  (aaa  Figure  10)  takas  advantage  of  operator 
entered  spead/haadlng  limits.  Tha  window  la  sited  as  follows! 
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operator  entered  ipaad  limits  for  ATI  region 
operator  antared  heading  limit*  for  ATI  region 
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target  range 

standard  deviation  of  measurement  error  in  target  report  atlmuth 

AT  *  alapi*d  time  since  potential  track  wai  initiated 
Than,  the  potential  track  correlation  window, la  altad  as  follow*! 

u  .  (H1  ±  h)  . 


T 


fe  ♦  Vl) 


AT 


AS 

AH 


(V2  -  Vl) 


AT 


+  K  (R  o.) 


(h2  .  Hj)  K  (R  o0) 

n  "h  n 


Tha  second  tern  In  the  expression  for  AS  and  AH  la  an  allowance  which  compansatas  for  measurement  errore. 
Only  the  effect  of  the  aslmuthal  error  need  ba  included  tinea  it  predominates.  Tha  multiplier,  K,  la  an 
optlmliatlon  parameter  and  a  valu*  of  one  has  baen  uaad. 

If. 

Xj,  Y2  -  coordinate*  of  report  for  which  correlation  i*  being  ettempted 
X^,  Yj  >  potentiel  track  poaition,  l.e.,  coordinates  of  first  report 
Then  the  candidate  report  la  correlated  with  the  track  ift 


3.3.2  Range  Rate  Correlation  and  Compatibility  Testa  for  Potential  Air  Tracks 

In  addition  to  tha  poeition  correlation  teats  described  above,  air  targets  detected  in  the  radar  PD  mode  are 
subjected  to  a  tangs  rets  correlation  test  and  a  tenge  rate  compatibility  test.  The  range  rate  correlation 
test  ia  simple  to  Implement  and  provides  effective  discrimination  against  nearby  targeta  moving  at  different 
spaeda  and  targata  moving  at  the.  same  apaed  but  at  different  heading*.  The  teat  simply  requires  that  the  tar¬ 
get  report  range  rate  be  within  a  prescribed  tolerance  of  the  range  rate  in  the  report  used  to  initiate  the 
potential  track. 
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Tha  rang*  rat*  compatibility  teat  provtda*  affective  discrimination  againat  nearby  targata  moving  at  the 
■ama  spaed  and  haadlng.  This  teat  is  implemented  by  raquirlng  that  tha  target  raport  rang*  rat*  b*  within 
a  tolerance  value  of  the  estimated  range  rat*  computed  from  the  track  velocity  component*.  Tha  teat  la 
implemented  as  follow* I 
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potential  track  position,  1.*.,  coordinates  of  first  report 

X,  V  coordinate*,  sslmuth  and  rang*  rata  of  raport  for  which  corralatlon  is  being 
attempted 

alapsad  time  sines  potential  truck  was  initiated 

standard  deviation  of  measurement  error  in  target  raport  rang* 

standard  deviation  of  maaaursMnt  error  in  target  raport  rang*  rat* 
estimated  track  rang*  rata 
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Using  analysis  of  variance  techniques,  it  can  ba  shown  that  the  rang*  rata  tolerance  which  should  b*  used  for 
the  compatibility  tasr.  tunas  the  form, 


whar*  K  it  an  optimisation  parameter  with  a  value  of  four, 
potantial  track  if, 


The  candidate  raport  la  than  correlated  with  tha 


3.3.3  Correlation  Window*  for  Tentative  Air  Tracks 


The  track  corralatlon  logic  used  for  tentative  air  tracks  can  ba  simpler  than  that  uaad  for  established 
tracks.  Established  tracks  usa  dynamically  alsad  correlation  wlndowa  supplemented  by  amallar  non-maneuver 
windows  to  perform  track  corralatlon.  Non-manauvar  windows  ara  uaad  to  datermlna  if  target  reports  are  from 
a  non-maneuvering  target  or  a  maneuvering  target.  Non-manauvar  windows  ara  oriented  in  rang*  and  aalmuth 
relative  to  tha  E-3A  to  taka  advantage  of  tha  fact  that  the  rang*  mass ur ament  is  much  more  accurate  than  tha 
sslmuth  raaaauramtnt.  That*  non-manauvar  wlndowa  are  dynamically  alsad  as  a  function  of  tha  error  estimate* 
provided  by  the  Kalman  filter  and  the  eensor  measurement  variance*  modelled  in  the  trscksr.  With  slight 
modification  to  window  multipliers,  established  track  non-maneuver  windows  esn  be  used  for  tentative  track 
corralatlon  wlndowa.  The  multiplier*  selected  for  tentative  tracks  ara  2o  in  tha  aslmuthal  dimension,  4o 
in  range,  and  8o  in  rang*  rats,  The  correlation  window  la  shown  in  Figur*  11.  Larger  multipliers  are 
required  for  rang*  end  rang*  ret*  windows  to  maintain  correlation  on  targets  undergoing  modest  maneuvers, 

These  windows  er*  adequate  for  most  scenario*  but  initiation  of  targets  undergoing  severe  maneuvers  oould 
ba  delayed.  The  2o  eeimuth  window*  provide  a  95*  chenca  of  correlating  reports  from  non-manauvsrlng  targets. 
For  maneuvering  targets,  the  probability  will  be  reduced  somewhat  depending  upon  the  magnitude  and  severity 
of  the  maneuver  and  tha  tima  alepaed  since  the  last  detection.  If  track  correlation  1*  loet  on  maneuvering 
targets,  the  tentative  track  would  probably  end  up  being  dropped  or  would  jump  to  an  uncorraleted  report  on 
another  target.  However,  Kalman  filter  gelne  are  quit*  large  during  the  tentative  track  phaa*  and,  there¬ 
fore,  the  tracker  he*  an  inherent  capability  to  follow  many  types  of  maneuvers  without  resorting  to  * 
dedicated  maneuver  detaction/rasponse  logic. 

3. A  Corralatlon  of  Target  Report*  with  Maritime  Tracks 

Maritime  track  correlation  windows,  Ilk*  sir  trsck  tentative  windows,  taks  advantage  of  tha  fact  that  the 
rang*  measurement  is  much  more  accurate  then  the  sslmuth  measurement.  However,  since  rasritlm*  targets 
travel  such  small  distances  between  scans  in  comparison  to  radar  measurement  errors,  an  accurst*  determina¬ 
tion  of  track  velocity  is  not  possible  during  the  ATI  phase  of  tracking.  Hence,  maritime  corralatlon  windows 
must  be  increased  in  sirs  to  account  for  the  possibility  that  tha  maritime  target  is  moving  at  very  high 
■peed.  Tha  correlation  window  thua  used  for  potential  and  tentative  maritime  tracks  tsks*  the  formt 


AR  - 

AR 

0 

+ 

V 

nux 

AT 

A6  - 

*e0 

a. 

V 

max 

AT 

T 

R 

19-8 


when , 

4 Rq  “  Ao  range  window  deicribed  In  paragraph  3.3.3 
46o  -  2p  asimuth  window  described  in  paragraph  3.3,3 
V  x  “  "ltxlnu»l  axpectod  speed  (or  maritime  tergal:  ' 

AT  >  elapsed  time  since  laat  correlation 
R  >  target  range 


The  second  term  in  th»  aquations  far  4R  end  46  la  the  tolerance  which  auef  be  added  to  accpuit  for  the  fact 
that  the  Initial  speed  estimate  of  aero  could  be  in  arror  by  as  much  as  V*Jx  knots .  It  should  be  noted  that 
the  use  of  this  added  tolerance  will  permit  a  better  maneuver  following  capability  in  the  potential  and  ten¬ 
tative  track,  phases  than  ia  possible  for  air  targats.  The  correlation  window  la  shown  in  Figure  12. 

3.5  Selection  of  Bast  Correlating  Report  1 

The  ATI  function  selects  tha  single  "beat"  report  for  tracks  except  that  reports  eligible  for  correlation  with 
potential  tracks  will  ba  limited  to  reports  that  hava  not  correlated  with  tentatlvu  or  established  traokn.  tne 
bast  report  is  tha  report  which  ia  closest,  in  a  normalised  sense,  to  the  center  of  the  correlation  window, 

Tha  Diaasura  of  cloaenaaS  is  calculated  as  follows! 

to  .  mi  +  mi  +  ..CAii2. 

*  °R2  V  °k* 

where,  AR,  46,  46  represent  tha  measurement  raaiduala. 

In  addition,  the  ATI  function  does  not  permit  e  report  to  update  more  than  one  track.  Target  report  conten¬ 
tions  are  resolved  using  the  TQ  value  calculated  above  to  select  the  bast  track/report  pair.  Tentative  and 
established  tracks  have  equal  priority  in  tha  bast  pair  election  logic. 

3.6  Track  Drop  Rules 

Potential  and  tentative  tracks  should  ba  droppad  whan  it  ia  determined  that  thera  is  high  likelihood  that  tha 
track  will  not  result  in  a  valid  track.  Logics  used  by  exiutlng  systems  with  ATI  functions  use  hlt/misa 
ratios  as  a  measure  of  track  quality.  However,  a  Kalman  filter  tracker,  through  its  covariance  matrices,  pro¬ 
vides  an  in,hsrant  capability  to  estimate  track  quality  dlrautly  and  this  can  ba  used  to  adventage  in  developing 
track  drop  rulaa. 

Aa  mentioned  in  paragraph  3.3.3,  Kalman  filter  cuvarluneas  and  measurement  error  variances  art  used  to  alaa 
tha  range,  aaimuth,  and  range  rata  tentative  track  correlation  windows.  The  behavior  of  tha  air  track 
asimuthal  correlation  windows  (for  a  measurement  arror  variance  aqual  to  that  produced  by  'the  radar  PD  mode) 
aa  a  function  of  tima  la  depicted  in  Figures  13,  14,  and  15  for  various  hit/miaa  pattern*.  The  hit/mle* 
patterns  era  shown  in  tha  legend  where  "x"  corresponds  to  s  correlation  and  V  corresponds  to  a  missed  corre¬ 
lation.  Figure  13  la  for  a  tentative  track  initiated  at  acan  2  aa  a  reeult  of  2  succaaalva  reports  on  tha 
target.  Figure  14  ia  for  u  tentative  track  initiated  is  a  reeult  of  2  reports  on  the  target  In  3  scene,  and 
Figure  15  la  far  e  tentative  treck  initiated  as  a  result  of  2  reports  in  4  scan*.  Tha  reason  that  the  corre¬ 
lation  windawa  in  Figures  14  and  15  are  smaller  ia  that  the  2/3  and  2/4  tentative  track  pairings  permit  a  more 
accurate  velocity  determination  than  the  2/2  tantativa  track  pairing  and  thia  improvement  ia  reflected  aa  a 
radii  cad  exponalon  rata  In  tha  correlation  window.  Tha  range  and  range  rata  correlation  window*  would  vary  in 
similar  manner  to  tha  asimuthal  window.  For  aaritltaa  tracks  tha  corresponding  correlation  windows  would  be 
smaller  than  sir  track  windows  by  about  a  factor  of  two. 

A  key  factor  in  minimising  falsa  track*  is  to  insuro  that  correlation  windows  do  not  gat  too  large.  Thia  aug- 
gasta  that  tentative  tracks  should  be  droppad  when  correlation  window*  exceed  soma  predetermined  limit.  Tha 
drop  logic  which  was  Implemented  for  tentative  tracks  compares  tha  larger  dimension  of  tha  correlation  window 
(asimuthal  dimension  In  nmi)  with  an  input  valua  UMAX.  If  this  valua  ia  exceeded,  the  tantativa  track  is 
droppad.  The  comparison  is  dona  after  track  covralatlon,  hence  tha  correlation  window  is  allowed  to  axcaad 
UMAX  for  ona  aoan.  A  valua  of  6  nml  haa  baan  selected  for  RMAX.  It  ia  prudent  to  ovarrlda  tha  RMAX  track 
drop  rule  after  a  relatively  large  number  (say  N2)  of  successive  misses,  thus  tantativa  tracks  are  droppad 
after  six  succsssivt  misses  even  if  tha  correlation  window  is  lass  than  RKAX.  Given  this  value  of  N2  and  e 
detection  probability  of  0.3,  only  about  102  of  the  tantativa  tracks  on  reel  targets  would  be  droppad  pre¬ 
maturely.  At  higher  detection  probabilities,  tha  percentage  of  prematurely  droppad  tracks  is  inalgn if leant. 

Karly  simulation  testing  suggested  that  the  RMAX  track  drop  rule  described  above  could  also  be  usad  to  advan¬ 
tage  for  potential  tracka.  In  this  case,  the  correlation  window  dimension  usad  for  comparison  iai 


for  411  <  90° 


for  4H  >  90° 

using  the  notation  in  paragraph  3.3.1,  Sinca  Hj  and  Hj  are  fixed  for  a  ATI  region,  the  sine  function  in  the 
expression  need  be  calculated  only  once. 

In  order  to  bettur  appreciate  the  affect  of  the  RMAX  track  drop  rule  on  potential  air  tTseks,  consider  soma 
examples  of  correlation  window  aliee  aa  a  function  of  time  since  track  initiation.  Figure  16  ahowa  tha  poten¬ 
tial  track  correlation  window  dimanaion  (D  in  aquations  abovo)  for  operator  entered  upper  speed  limits  (V,)  of 
1000  and  2000  knots,  for  u  target  at  fighter  detection  range,  for  tha  PD  arimuth  measurement  arror  variance, 
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and* for  various  operator  entered  heeding  Unites  So,  for  example ,  If  RMAX  »  6  nml  and  AH  «  45°,  up  to  two 
miuues  would  be  permitted  for  Vj  -  1000  knots  but  no  mleeee  would  be  permitted  for  Vj  “  2000  knot*. 

Tha  ATI  track  drop  logic  described  above  provides  an  optimum  control  logic  which  Insures  that  false  track 
Initiation  rates  are  relatively  constant  as  target  and  sensor  conditions  change.  The  logic  offers  a  dis¬ 
tinct  advantage  over  conventional  logics  based  on  hit/miss  thresholds,  baceuse  It  adapts  automatically  to 
individual  targat  hit/mlas  pattams,  target  range,  target  report  type,  and  operator  entered  apead/haadlng 
limits.  The  values  of  N1  (number  of  hlta  to  establish)  and  RMAX  ware  selected  to  provide  tha  desired  bal¬ 
ance  between  false  track  Initiations  and  valid  track  initiations.  Once  established,  this  pair  of  nuabers 
provides  an  optimum  balance  for  a  variety  of  target  geometries  and  tensor  characteristics, 

In  addition  to  airing  potential  track  correlation  windows,  operator  entered  speed  and  heading  Haiti  (with 
approprlata  tolarancaa)  art  uaad  as  a  final  check  on  air  tracks  before  promotion.  If  promotion  rules  have 
been  satisfied  but  the  track  is  not  within  appropriate  speed  end  heading  Unite,  the  tentative  track  la 
dropped.  For  maritime  tracks  only  e  spaed  check  la  made  to  drop  tracks  which  are  moving  faster  than  tha: 
maximum  expected  maritime  targat  apaad.  Early  simulation  results  have  shown  that  thla  final  check  la  use¬ 
ful  in  dinuerding  coma  of  tho  falsa  tracka  which  raault  from  croaa-corralatlona  in  the  tentative  phase. 
Croee.’c-orrelatlona  in  this  phase  usually  result  in  velocity  distortions  which  art  severe  enough  to  place 
the  track  outside  speed  and/or  heading  limits.  Obviously,  some  real  tracka  could  ba  dropped  by  this  taet, 
but  simulation  result*  have  shown  that  this  ia  a  rare  occurrence. 

3.7  Track  Smoothing 

Tha  ATI  function  employs  decoupled  2x2  Kalman  flltara  (X,  X  and  Y,  Y  cocrdlnatan)  for  amoothlng  ATI  traoki. 
Tha  Kalman  flltara  art  Identical  to  thoea  uaad  for  established  tracks  thus  muring  a  smooth  transition  of 
ATI  trackc  to  established  statue.  For  air  targets,  a  track  la  initialised  upon  promotion  to  tentative  statue 
using  tlui  velocity  computed  from  tha  two  reports  on  tha  target.  Tha  air  track  Kalman  flltara  ara  alio  initial¬ 
ized  at  thia  time  uaing  appropriate  variances.  For  maritime  target!,  the  track  la  initialised  at  saro  speed 
and  Its  Kalman  flltara  are  initialised  whan  the  potential  track  is  Initiated,  Track  amoothlng  .commences  at 
tho  tlms  of  the  next  correlation. 

3.8  Track  Prediction 

Track  prediction  is  performed  in  standard  manner  by  linearly  extrapolating  the  X  and  Y  track  petition  to  tha 
time  of  tha  noxt  expected  target  report  uaing  the  currant  estimate  of  track  velocity.  Tha  corresponding  values 
of  predicted  range,  azimuth,  end  range  rata  mqst.  take  Into  account  the  fact  that  the  E-3A  ie  moving.  Extra¬ 
polation  of  the  moat  current  E-3A  navigation  data  yleldf  the  eitimsts  of  E-3A  position  nauaasnry  to  cAculata  • 
these  predicted  valuaa.  Since  more  currant  navigation  data  la  available  at  tha  tlma  nf  correlation  and 
smoothing,  errors  introduced  by  E-3A  maneuvers  are  minimized. 

3.9  Established  Track  Processing 

Ths  only  basic  difference  between  established  and  tantatlva  track  procaealng  logics  la  that  established  tracka 
amploy  a  dadicatad  manauvar  datactlon/manauver  response  function.  Non-manauver  windows  (supplemented  by  larger 
correlation  windows  are  used  to  perform  the  maneuver  detection  function.  Whan  a  maneuver  is  confirmed,  s 
special  maneuver  reaponea  logic  is  employed  to  update  the  track, 

4.  '  SIMULATION  RESULTS 

Tha  ATI  design  described  in  Section  3  was  evaluated  uaing  a  variety  of  non-maneuvering  and  maneuvering  targat 
raid  formations.  A  sampling  of  initiation  performance  la  presented  in  thia  section.  .  The  behavior  of  tha  ATI 
design  la  controlled  almost  entirely  by  tha  valuaa  for  N1  (number  of  correlations  in  tentative  phase  required 
to  promote),  N2  (maximum  number  of  misses  allowed  In  potential  ot  tentative  phases),  and  RMAX  (drop  criterion 
based  on  correlation  window  size).  Recall  that  a  potential  or  tentative  truck  la  dropped  after  an  unsuccessful 
correlation  attempt  if  tha  wider  dlmonsion  of  the  correlation  window  exceeds  RMAX  nml,  Tha  standard  valuaa 
used  In  the  simulation  wat.'S 

N1  «  2 
N2  -  6 

RMAX  -  6  nml 

Tha  results  presented  are  for  the  20  target  formation  shown  in  Figure  2  with  targat  spacing*  of  about  S  nml. 

All  targets  in  the  formation  move  at  tha  aama  apaad  and  heading  thus  presenting  a  worst  case  situation  for  tha 
ATI  function.  For  air  targets,  tha  radar  modal  depicted  In  Figure  3  wsa  used  and  the  initial  target  range* 
were  near  a  normalized  range  of  1,0.  For  marltima  targets  the  constant  single  scan  detection  probability  radar 
modul  waa  uaad  and  tha  Initial  targat  ranges  ware  near  lins-of-slght  range  to  tha  horizon, 

4,1  Non-Maneuvarlng  Air  Target* 

Figure  17  depicts  Initiation  performance  for  S00  and  2000  knot  fighter  targat  formations.  The  performance 
sensitivity  to  target  azimuth  (9  in  Figure  2)  in  also  shown.  Performance  la  expressed  In  terms  of  percent 
tracka  Initiated  as  a  function  of  tlma  since  the  start  of  the  simulation,  averaged  over  10  Monte  Carlo  trials, 

A  target  Is  conslderod  initiated  at  the  tins  of  promotion  to  established  status,  l.e.,  after  four  correlations 
on  tha  targat.  Thus  tha  earliest  possible  Initiation  Is  at  .67  minutes  (four  scans)  if  four  succasslva  detec¬ 
tions  arc  made  on  the  target. 

Tha  higher  speed  targets  are  Initiated  faster  because  detection  probability  increases  faster  than  for  low  speed 

targets.  Aa  expected,  speed  of  Initiation  ia  more  aeniitive  to  targat  azimuth  at  the  lover  target  speeds,  with 

tha  180°  targat  azimuth  (l.e,  tall  chase  geometry)  being  the  worst  case.  For  this  azimuth,  closing  spaed  on 
the  E-3A  ie  minimized,  thus  the  target  spends  much  of  lte  time  in  the  low  probability  of  detection  region.  At 

the  higher  target  speed  the  speed  of  initiation  is  insensitive  to  target  azimuth. 


Other  per  fortune*  parameter*  of  interest  are  shown  in  Table  2  below  for  each  of  the  two  target  speeds.  The 
table  entiles  represent  averages  over  the  five  azimuths  for  10  Monte  Carlo  trials.  The  entry  for  "track 
initiation  attempts"  represent*  the  average  number  of  track  initiation  attempts  on  the  20  targets,  thus  61 
(81  minus  20)  of  the  potential  tracke  initiated  on  the  500  knot  targets  were  dropped  sometime  during  the  ATI 
phaee  versus  33  (53  minus  20)  of  Che  potential  tracks  initiated  on  the  2000  knot  targets.  The  reason  that 
the  number  is  so  much  higher  for  the  low  speed  target*  le  that  their  lower  closure  rates  with  respect  to  the 
E-3A  results  in  lower  detection  probabilities.  Thss*  lower  detection  probabllltlee  in  turn,  require  more 
initiation  attempts  before  the  initiation  criteria  ere  satisfied.  The  second  entry  in  the  table  ie  the  maxi¬ 
mum  number  of  track*  (sum  of  potential,  tsntativs,  and  established  tracks)  which  exist  simultaneously.  This 
number  is  important  because  it  provide*  an  indication  of  the  track  storage  required  for  ATI  tracks  over  and 
above  the  track  capacity  for  established  tracks.  The  third  entry  represent*  th*  percentage  of  established 
tracks  which  ere  valid,  where  a  valid  track  is  defined  te  e  track  promoted  to  established  statue  based  on 
detections  from  the  eame  real  target.  This  lest  entry  le,  of  course,  a  key  measure  of  performance  for  an  ATI 
function  because  the  number  of  false  tracks  (releted  to  th*  complement  of  th*  entry)  represents  an  added  work¬ 
load  for  surveillance  operators. 

TABLE  2 

OTHER  ATI  PERFORMANCE  PARAMETERS  (AIR  TARGETS) 


Target  Speed 

500  Knot*  2000  Knots 


Number  of  Track  Initiation  Attempts  81  53 

Maximum  Number  of  Simultaneous  Tracks  25  24 

Valid  Track  Initiation  Ratio  CPcrcent)  9?  98 

4.2  Non-Maneuvering  Maritime  Target* 

Figure  18  depict*  initiation  performance  for  maritime  targets  as  a  function  of  probability  of  detection  (Pd). 
The  figure  represent!  an  average  of  high  end  low  target  spaed  performance  alnce  performance  ie  very  insensi¬ 
tive  to  target  speed. 

Table  3  lists  the  other  performance  parameters  of  interest,  The  entries  for  "track  initiation  attempts"  end 
"eimultaneoue  tracks"  should  not  be  compared  directly  to  the  equivalent  entries  for  air  tracks  nine*  false 
report  rates  ere  much  higher  In  the  maritime  radar  mode.  Even  with  the  higher  false  report  rates,  initiation 
of  maritime  targets  ie  a  much  easier  problem  (as  reflected  by  the  very  high  valid  track  initiation  ratioa) 
because  targets  move  very  slowly,  thereby  minimising  target  interference  effects. 

TABLE  3 

OTHER  ATI  PERFORMANCE  PARAMETERS  (MARITIME  TARGETS) 


Fd 

j3 

JS 

u! 

59 

53 

55 

32 

31 

32 

99 

99 

100 

Number  of  Track  Initiation  Attempt*  59  53  55 

Maximum  Number  of  Simultaneous  Tracks  32  31  32 

Valid  Track  Initiation  Ratio  (Percent)  99  99  100 

4.3  Maneuvering  Air  Targets 

The  correlation  windows  for  tentative  tracks  must  be  large  enough  to  accommodate  target  maneuver*  without 
degrading  the  capability  to  discriminate  against  nearby  targets.  The  correlation  windowa  described  in  para¬ 
graph  3.3.3,  l.e.,  2c  in  azimuth,  4c  in  range,  8c  in  range  rate  provide  e  good  compromise.  It  was  found  that 
ATI  performance  on  maneuvering  targets  (Figure  2  geometry  with  20°  dog- legging  maneuver#  evary  2  minute*)  was 
virtually  identical  to  the  performance  nhown  in  paragraph  4,1  for  non-maneuvering  targets.  Significant  .dsgr;  - 
dationa  in  ATI  performance  are  not  expected  until  maneuvers  begin  to  exceed  50°  fur  low  epaed  targets  and  25° 
lor  high  speed  targets, 

5.  CONCLUSIONS 

A  multiple  target  tracking  Monte  Carlo  simulation  model  was  developed  to  support  ATI  studies  for  the  NATO  E-3A. 
The  simulation  model  was  essential  to  support  this  effort,  since  performance  of  an  ATI  function  in  very  depen¬ 
dent  upon  the  target  environment,  the  false  report  environment,  and  the  in  ter- target  dynamics.  'The  simulation 
model  Is  readily  adaptable  and  can  be  used  to  .explore  a  variety  of  ATI  design  alternatives.  Furthermore,  tha 
model  has  general  application  to  the  evaluation  of  all  aspects  of  tracking  performance  for  tha  E-3A  or  for  any 
track-wh.Ue-scan  system. 

The  ATT  studies  have  shown  that  cross-correlation!  between  adjacent  targets  are  a  potentially  serious  problem 
and  conscious  efforts  muat  be  made  to  minimise  their  occurrence.  Cross-cortelatione  are  the  dominant  cause  of 
false  tracks  and  they  also  delay  initiation  of  tracks  on  reol  targets.  The  ATI  danign  described  Jr  th'e  paper 
employs  several  unique  features  which  effectively  minimize  the  effect  of  nearly  ta  gets.  The  design  achieves 
a  good  compromise  betweon  treed  of  truck  initiation  and  false  truck  initiation  rates. 
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Fig.4  Scaa-to-scas  target  and  trade  data 


ii 


!|i- 


ooooocoooeooooeoooooooooaooooo 

OOOOOOOOOOOOQOOOOOOOOOOOOOOOOO 


OOOOOGOOOOOQOOOOOOQOOOOOOOOOOO 


OOOOOOOOOOOOOOOOOOOOOOQOOOOOOO 


ooooocooooooooor5oooooooooooooc>a 


m  nnninnn  m  min  nnnnn  mmm  m  m 


*  #  O  *  0*#*»*#*0**#***#4**a*4##* 

r*  p*  r-  r*  r-  f»  r*  r«  p*»  p»r»r-»-»- 

WONNfNfSINOlNNINONONONINNfNNNNNNNONNN 
f-  M  M  IN  IN  f»*  IN  IN  (N  IN  IN  IN  IN  M  IN  IN  IN  IN  IN  fN  M  IN  IN  IN 

NOprOfppr  p*'i»»^*f»p*p»**p«^(r,©r*f-Of»,«r*i-p«#-»« 

p-  MIN  M  IN  N  M  PN  M  M  M  M  IN  M  M  M  M  IN  fN  (MINNINNNN 


o  o  ©  ©  0(5)0  OOOOOCOOOOOOOOCCOOCOOOO 
r*  r-  p-  r*r-r»r,»"^-r-  r-r*  r**-  ►-  r*  P“ 

ON  O  ©ficjO  OCn9HrDOOiOO»9IOi<MMMhON9i9NOO«OOiO' 
rl^  NNN  NIMN  NNNNNNNPHNNN  IN  M  M  M 

gTS6o  4<l40«O«tf#O«««O««<«««llOM«O« 

14  MM  M  N  M  IN  MINN  NMMINNMM  N  IN  IV  IN 

ofioDnfflioncAeiocgoAafHOrvottnaDdiiooaaicaMC 

ci*-fVp>-prr‘'*ri“t-rrrrr  *-  r*  *-  »•  r“  *-  r-  p-  p»  f- 

ip4*p,i1'  r  p  r  p  ^  »»i«  r  p*  p-  r*p*  p-  f  p»  ^  p» 

MMor*-oor*f*r-oor»Mr*or*Mh*ooor*i'»ooMMrNMr-,‘ 


*Oi0OvOOtfOlOO444}O^tA,4il9i64i0ifl4)iAiOi0iAlO4)iOiA 


i/ni'io^o/u/ivwiiTioinoooin/iOinmai/irfi^ioooooiii 


or-MMMOMor»NMOf,"r-r,*h*Kr«r‘OMr,'Op"Mr»MMor* 

pm  ».  »»*  *->  ••  *■►»*“*  *•  r«-  r*  •-  t-  r-  r*  r-l-  p*  p»  **• 


4440O04044#004«<M444«4  40«4  4440 


I'liNmrinmntiOiii’iMnowoinfimnnnoonnowi'iH 


fto^ooooooooooooooooooooooooo 
^SM  iunmnnfnnrtHnnwMinci  m  rtnwn 


»•■  »*•  ^3  r*  r-  OCN  IN  ( 


r«Mr'>*i/1tfir»*0NOP'*Mni.i*»AvOM©tfvr>l-Mm#knu>MflO<*O 

i-p-*-fp*»-^^p-t-MlNMMlNMlNMiN*NM 


Fig  .5  Track/target  correlation  matrix 
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Fig.6  Track  history 
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Fig.  1 1  Tentative  air  track  correlation  window 
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Fig.  12  l’otcntlnl/tentafive  maritime  track  correlation  window 
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ABSTRACT 

Video  disk*  are  a  new  technology  that  provide  inexpensive  storage  (CSp/dlsk)  and  rapid  access  (as  little 

as  1/8  sec.)  to  large  numbers  ($4,000  pictures/disk  aide)  of  photographs.  For  a  typical  airport,  it  is 

poaslbla  to  atora  on  a  vldso  disk  compraasad  movies  showing  all  runway,  take-off,  lidding,  circling,  and 
approach  paths.  Whan  such  a  disk  is  viewed  on  a  player  and  television  controlled  by  a  a Imp la  microproc¬ 
essor  ,  th*  pilot  can  vicariously  fly  himaalf  around  an  airport,  land,  take-off,  texi  end  circle.  The 

pilot  eees  an  imaga  with  photographic  raallam,  can  chooaa  his  own  path  and  apead,  end  can  chooee  time  of 

day  or  waether  condition*  for  tha  simulated  trip.  Such  a  syatan  in  one  hundred  times  las*  expensive  than 
a  conventional  flight  simulator. 

1.  INTRODUCTION 

I 

Vidao  disk-basad  flight  tralnars  wara  davalopad  to  provide  th*  student  with  vicarious  flight  axpirlanca 
and  knowladga  of  tha  charactarlstici  of  particular  airport*.  Tha  technology  has  advantages  over  movlea 
of  flight  and  of  airporta  in  that  tha  student  can  chooaa  hla  path  and  llna  of  eight.  Th*  tenhnplogy  also 
haa  advantages  over  conventional  flight  simulator*  in  that  tha  imagery  has  photographic  rtallem,  no  costly 
digital  data  base  of  tha  airport  and  tarrain  neada  to  ba  davalopad,  and  tha  hardvara  and  software  of  tha 
video  dlek-baeed  flight  tralnsr  ia  vastly  laas  axpanalva  than  currant  color  thrae  dimensional  display 
processors. 

2 .  BACKGROUND 

Video  disks  ere  similar  to  audio  records,  except  that  thay  atora  plcturas  Instand  of  sound.  Each  of  the 
two  sides  of  a  twelve  inch  diameter  vidao  disk  can  store  thirty  mlnutee  of  television,  the  equivalent  of 
$4,000  still  picture*  (30  minutes  x  60  eaconda/minut*  x  30  framaa/aaoond) .  A  vldso  disk  playar  can  show 
tha  video  disk  as  e  movie,  including  capabilities  for  alow  motion  forward  and  backward,  scanning  forward 
and  backward,  and  stopping  on  a  aingl*  frame.  With  die  current  technology  In  the  marketplace,  th*  surface 
of  the  video  dlak  is  read  by  msesuring  the  reflectance  of  a  laser,  and  so  th*  disk  navar  wear*  out  due  to 

physical  wear,  In  addition,  tha  vidao  dlak  player  can  randomly  accaas  any  of  the  $4,000  frames  on  th* 

video  disk  in  a  maximum  of  three  seconds  and  a  minimum  of  about  1/8  second  because  each  frama  is  digi¬ 
tally  coded  with  a  frame  number,  even  though  the  picture  itaelf  ia  an  analog  signal.  Tha  frame  to  be 
found  is  definad  by  keying  a  frame  number  into  a  control  on  the  video  disk  playar,  or  can  be  defined  by 
sending  digital  signals  to  a  standard  electrical  connector  on  tha  video  diek  playar. 

Video  disks  can  be  made  in  a  number  of  ways.  Ws  begin  with  s  16mm  film  that  should  bs  consldsrsd  * 

sequence  of  still  frames  rather  than  a  movie.  In  addition,  35mm  film  or  vidao  tape  can  ba  uaad  kb  th* 
original  material.  If  film  ia  ueed ,  it  i*  converted  to  video  tape.  The  final  vidao  signal  la  used  to 
produce  a  master  video  diuk,  and  this  master  in  turn  1b  used  ae  a  stamper  to  produce  vidao  disks  in  much 
ths  ssme  way  that  audio  Uisku  era  produced.  Consequently,  video  disks  esnnot  he  changed  unless  tha 
original  material  is  edited,  followed  by  the  production  of  a  meeter  and  new  video  disk*. 

When  video  dlak  players  are  controlled  by  a  computer,  the  combination  can  be  ueed  to  provide  a  viewer 
with  a  personalised  movie.  A  number  of  viewing  options  are  stored  on  ths  video  disk,  and  with  tha  aid 
of  the  computer  to  locate  particular  movin  segments,  the  user  chooSBe  among  options  to  see  what  ha  wants. 
Because  of  tha  rapid  random  search  capability  of  the  video  disk  player,  an  essentially  continuous  movie 
can  be  displayed. 

The  problem  with  this  approach  to  personalised  movies  is  that  the  total  capacity  of  the  video  disk,  thirty 
minutse  on  s  side,  does  not  allow  for  a  large  number  cf  viewing  options.  If,  for  example,  the  video  disk 
contained  ten  viewing  options,  the  user  might  choose  a  personalised  movie  only  thro#  minutes  long. 

One  potential  solution  is  to  store  and  dieploy  fewer  than  thirty  framea/aacond  for  movie  viewing.  For 
some  subject  matter,  such  at  vary  alow  motion,  many  fawar  than  thirty  framee /second  can  b#  employed  and 
the  resulting  display  atill  appear*  to  be  of  continuous  motion,  For  other  action,  such  a«  the  view  out 
of  an  airplane,  dieplaying  many  fawar  than  thirty  framea/eecond  produce#  the  appearance  of  discontinuous 
motion.  Fortunately,  in  this  casa  the  discontinuous  motion  is  not  burdonaomo  For  the  viewer  and  provide* 
th#  advantage  of  allowing  th*  storage  of  hours  of  flight  on  a  vidao  disk  and  tha  atorsge  of  a  number  of 
flight  options. 

3.  APPROACH 

We  have  produced  a  flight  trainer  for  travel  on  and  around  e  small,  rural  airport  -  Frederick,  Maryland, 
US.  We  filmed  view*  from  the  cockpit  of  an  airplane  facing  forward,  to  tha  right,  and  to  th#  left. 
Simultaneously,  we  filmed  selected  instruments  on  the  instrument  panel.  Frames  ware  photographed  evarv 
half  second.  Film  waa  collected  while  tha  plane  performed  the  following  movement!!  take-off  and  landing 
from  each  of  the  four  runways,  including  travel  to  and  from  tha  aprons  circling  at  a  radius  of  on#  half 
milt  and  a  radius  of  one  mile,  at  altitudes  of  1100  feet  and  2500  feots  and  trr.naition*  among  ths 
circllnge,  take-offs  and  landings. 


A  video  disk  vrs  produced,  end  e  digital  Index  wee  prepared  that  Hated  the  location  on  the  video  disk 
(frame  numbers)  of  each  segment  of  plane  travel.  Software  In  a  microcomputer  Conner tad  to  the  video  dlek 
player  controlled  the  display  of  flight  options  and  viewpoints,  baaed  on  commands  delivered  to  tha  micro¬ 
processor  by  the  urer  using  a  joystick  and  function  button  controls  that  did  not  attempt  to  simulate 
realistic  flight  controls. 

A.  DISCUSSION 

Movies  are  typically  used  to  familiarise  students  vlth  particular  airports.  The  video  disk-based  flight 
trainer  performs  this  function,  end  give*  the  additional  advantage  of  allowing  tha  student  to  control  hie 
flight  or  taxi  path,  his  viewpoint,  and  hla  spaed.  Tha  flight  trainer  it  more  expensive  than  movia  pro¬ 
jection  equipment,  end  evaluation  Is  needed  to  determine  whether  it  la  more  oost-effactlvw,  in  Important 
part  of  the  calculation  la  that  tha  flight  tralnar  it  apparantly  more  attractive  end  "fun"  to  use  then 
passive  viewing  of  a  movie,  and  hance  may  laad  to  batter  learning,  end  more  viewing  and  practice. 

Flight  simulators  can  aubatltute  for  soma  in-flight  training  in  an  affort  to  raduea  training  costa. 
Unfortunately,  tha  display  procaasora  of  flight  simulator*  art  quits  axpaneiva,  and  tha  construction  of 
•  digital  data  base  for  ah  airport  or  other  arts  is  a  major  undertaking.  At  bait,,  the  dlepley  appears 
certoon-like.  With  the  inexpensive  flight  tralnar  tha  display  has  photographic  realism,  no  digital  data 
bsaa  describing  tha  terrain  and  cultural  features  is  needed,  and  an  axpaneiva  display  processor  le  elimi¬ 
nated.  Unfortunately,  with  the  flight  tralnar  the  student  can  choose  among  *  modust  number  of  pre¬ 
recorded  paths  and  vlawi,  e.g.  fifty  to  one  hundred  options.  With  e  flight  simulator  the  student  nan 
choose  among  an  essentially  infinite  number  of  flight  paths,  including  crashing,  end  hance  experiences 
more  realistic  dynamics,  if  lass  realistic  displays.  Hence  the  device  described  in  the  paper  is  termed 
a  flight  trainer  rather  than  a  flight  almulator,  Evaluation  is  needed  to  determine  whether  a  flight 
trainer  using  video  disk  technology  1*  more  or  leea  cost-effective  than  e  traditional  flight  almulator. 
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-  R  E  S  U  H  E 


Cat  expos*  tralte  de  la  conception  d'un  slmulateur  de  vol  d'Stude  adapts  aox  problftrms  spiel  - 
flques  das  hSHcoptSras  mllltalres  pour  la  dtflnitlon  at  mlse  au  point  d'uneavlonlque  moderns. 

II  montre  comment  1e  besoln  exact  a  fits  dif Ini ,  en  partlcullor  dans  le  cadre  du  dtvel oppamant 
d'un  nouveau  programme  hSHcoptSre. 

Les  principal es  caractSrlstlques  d'un  tel  slmulateur  sont  prSsentSes  alnsl  qu'une  llste  das 
points  jug*s  critiques  pour  ce  projet  -  Sommalre  :  1.  Introduction  -  Z.  Analyse  prSUmlnalre  du 
besoln  SDVEH  *  3.  Contralntes  du  projet  -  4,  Organisation  gSnSrale  et  programme  de  dSvel oppamant  - 
5.  Points  critiques  -  6.  Conclusion. 


INTRODUCTION 

Dans  le  doinalne  des  Hftllcoptdres  Mllltalres.  1' Importance  de  1'avlorilque  par  rapport  *  la  motorlsatlon 
•t  au  vSMcul  ••  crolt  rapldement.  Cecl  peut  s'expllquer  par  : 

A.  Le  dfislr  des  0p*rat1onne1  s  d'fitendre  le  champ  d 'application  des  HdllcoptAros  do  deux  Tagons  ditf#- 
rentes. 

Tout  d'abord,  11  est  demand*  de  pouvolr  rempllr  des  missions  nouvelles  d'appul  anti-personnel, 
d'escorte  et  de  lutte  air-air  ant1-h*1 icoptftre  necassltant  la  ml’sa  en  oeuvre  de  syst*mes  d'arme 
plus  complexes. 

D'autre  part,  11  est  domand*  de  pouvolr  rempllr  certain**  missions  de  jour  comma  de  nult  et  dans 
certains  cas  de  mauvalse  vlsiblllte,  ce  qui  nscesslte  le  plus  souvent,  la  mlse  en  oeuvre  de  noyens 
optronlques  sophl stlquis . 

B.  Le  nScessIt*  de  malntenir  Tefflceulb*  upfirationnelle  dus  Helicopter**  cans  1'avenlr  sn  revalorl- 
sant  leurs  systRmes  Car, mil. 

Les  progius  coal  I  si*,  en  matlbra  de  "guerre  eiectronlqus"  Impllquont  d*s  malntenanb  de  orevolr  des 
tiwyens  ewbarquts  de  Contra-Mesures  Electronlques.  Par  allleurs,  de  nouveaux  types  d1  Intervention 


\ 

basfis  sup  les  actions  comblneas,  (example  :  les  designations  de  olbles  A  I'alde  de  moyens  jt'  Illu¬ 
mination  et  da  detection  laser)  Impllquent-  la  mlse  en  oeuvre  d'une  avionlque  co.npl cxe, 

Knfln,  I'avfinement  des  commandes  eiectrlques  lalsse  entrevolr  de  nouvolles  posslbllltes  promet- 
teuses  en  matiere  de  pilotage. 

Cette  Importance  croissants  de  l'avlonlque  en  rend  la  conception  at  la  mlse  au  point  plus  complexes 
et  plus  longues, 

Dans  la  cadre  d'un  nouveau  programme.  11  devlent  ImpAratlf  de  lancer  des  etudes  tris  completes  de 
l'avlonlque.  des  1e  debut  du  programme  afln  de  respecter  les  ddlals  de  developpamsnt  et  d'evlter  des 
modifications  tardlves  de  l'avlonlque  qul  rlsquent  d'Otre  coflteuses  et  de  degrader  1'efflcaclte  ope* 
ratlonnelle. 

En  effet.  la  complexlte  d'une  avlonlque  moderne  en  rend  toute  modification  tres  delicate.  &  mesure 
que  1'on  progresse  dans  sa  definition,  en  particular  une  fol s  que  1 'on  a  attaint  1e  stade  des  assals 
en  vol  d'un  prototype. 

Par  allleurs,  les  Interactions  entre  la  cellule,  la  motorisation  et  l'avlonlque  sont  de  plus  en  plus 
Importantes  i  11  devlent  ndcessalre  de  condulre  In  developpemnnt  des  trols  entltes  conjolntement  au 
niveau  des  etudes  de  fagon  A  assurer  une  Integration  rfiusslc. 

Un  slmulateur  sol  permettant  entre  autre  d'analyscr  le  comportement  en  vol  d'un  equipage  d'hellcoptera 
au  cours  d'une  mission  est  1 1 un  des  moyens  d' etude  adaptfe  pour  risoudre  ces  dlfflcultes. 

L'expSrlence  montre  en  outre  qu'un  slmulateur  adaptable  aux  prob'lAmes  poses  sst  ur.  nwyen  rentable 
efflcace  et  parfols  unique  de  menor  certalnes  etudes  (example  :  la  mlse  au  polri  d'un  systime  d'arme 
dans  dlfferentes  configurations  de  combat  dlfflclles  A  obtenlr  en  conditions  reel  les  d'essai  ou 
1 'analyse  de  la  charge  de  travail). 

L'objet  de  ce  document  est  de  presenter  un  projet  de  developpament  d'un  slmulateur  d'etude  oongu  dans 
cat  esprit. 

Ce  projet  s'appelle  Slmulateur  De  Vol  d'Etude  pour  Heilcostere. 

Z.  ANALYSE  PRELlMINAIRE  DU  BESOIN  SDVEH 
2.1.  APPROCHE  PU  BESOIN 

Inltlalement,  le  SDVEH  Ate i t  dbflnl  coume  une  Installation  capably  de  s.muler  en  temps  reel  le 
vol  d'un  helicopter*  Integrant  la  participation  effective  d'un  equipage. 

II  eta  It  nAcessalre  de  prbclser  cette  definition  event  d'entreprendre  toute  realisation,, 

La  complexlte  du  sujet  nous  a  conduit  A  adopter  unn  spproche  salon  trols  grands  principal. 

A,  Le  SDVEH  dolt  6tre  consIdArA  comma  un  tout  : 

C'est-A-dlre  ne  pas  decomposer  A  priori  le  SDVEH  en  sous-enseroblas  Independants  pouvant  falre 
l'objet  de  definitions  independences,  uu  djiflnlr  le  SDVEH  rn  negligeant  certains  de  ces  as* 
pacts  comme  celul  de  sa  mlse  en  oeuvre  par  ses  future  utllisateurs  au  profit  de  celul  de  ces 
objectlfs  d'etude. 

Le  schema  suivant  11  lustre  cette  attitude  de  depart. 


C'est-4'dlre  analyser  l'envlronnement  d'ltude  dans  lequal  s ' Inscrlt  It  SDVEH  afln  d'tn  prl- 
clstr  tous  Its  aspects  et  fixer  des  object-! f s  concrets,  Ichelonnls  dans  1e  temps. 

L'analysc  des  points  sulvants  est  essentlelle. 


objectlfs  d'atudes  1  prlclser  s' 11  s'aglt  da  court,  moyon  ou  long  terme 

-  objectlfs  de  mlse  an  oeuvre  J 

-  complSmentarltl  du  SDVEH  par  rapport  aux  autres  moyens  d'ltude. 


C .  Lr  SDVEH  dolt  Otre  comorls  pour  sa  realisation  copme  un  ensemble  d'lltments  en  Interaction 
dote  d'une  organisation 


II  convlent  d'ltablir  le  schftna  fonctlonnel  et  organlque  du  SDVEH  prflclsant  les  dlfflrents 
sous-ensembles,  les  relations  Internes  qul  existent  entre  eux  alnsl  qua  les  relations  externes 
avec  des  ensembles  ne  falsant  pas  partle  du  SDVEH  mals  en  interaction  avec  ce  dernier. 


Le  travail  a  Sti  air.orct  en  dlflnlssant  et  analysant  d’une  part  les  objectlfs  d'etude  du  Simula- 
teur  at  d'autre  part,  les  objectlfs  pour  sa  mise  en  oeuvre  par  ses  utlllsateurs  future. 

2.1.1.  Objectlfs  d'ltude 
Object tfa-Olnlreux 

Les  objectlfs  d'ltude  ort  d'abord  Itl  dlflnls  d'un  point  de  vue  gtntral,  an  consldlrant 
les  dlfflrentes  phases  caractlrlstlques  du  dlveloppement  d'un  nouveau  programme  hlll- 
coptlre  et  pour  chacune  d'elle,  la  fagon  dont  le  SDVEH  pouvalt  Intervenlr  en  Insistent 
sur  les  points  sulvants  : 


-  position  du  SDVEH  par  rapport  aux  autres  moyens  d'ltude  dlsponlbles  dans  cette  phase 

-  stade  de  dlveloppement  de  la  machine  et  de  I'avlonlquo  dans  cette  phase. 


La  Planche  1  resume  les  objectlfs  g6n6raux  d'etude  retenus. 

On  a  en  particuller  mis  en  Evidence  que  la  conception  et  mlse  au  point  de  1'avlonlque 
d'un  nouveau  programme  Indult  des  etudes  qul  peuvent  deborder  de  leur  cadre  habltuel 
correspondent  aux  phases  de  falsablllte  et  de  definition t  et  qul  constituent  des  applica¬ 
tions  possibles  du  SDVEH. 

Cecl  rlpond  en  particuller  I  la  dlfflculte  de  mlse  au  point  des  symbologies  ou  4  1 1 1m- 
posslblllte  de  reconnhltre  cortalns  probiemes  avant  de  disposer  d'une  avlonlque  compllte- 
ment  dlflnle  alnsl  qu'au  caractdre  evolutlf  des  systftmes  d'armu  modernes. 

Ob J ectlfs  d1 etudes  speclfloues 

Oes  objectlfs  d'etudes  spdclflques  ont  4t#  d#gag#s  4  parti r  des  objectlfs  generaux  en 
conslderant  des  programmes  ou  projets  particulars  en  cours  ou  4  venlr. 

Chaque  etude  retenue  a  6te  deflnle  dans  la  masure  du  possible  par  ses  objectlfs  exacts* 
la  date  4  laquelle  ell*  dolt  #tre  menfte  et  la  phase  correspondante  du  programme  dont  el  1 e 
est  Issue.  De  plus,  on  s'est  attache  4  la  definition  de  cs  qu'll  etalt  Important  de  $1- 
muler  pour  val  Ider  les  resultats  de  1 'etude. 

2.1.2.  Ob.lectlfs  de  mlse  en  oeuvre 

Les  objectlfs  d'etudes  ont  ete  completes  par  des  objectlfs  de  mlse  en  oeuvre. 

-  Le  SDVEH  dolt  6tre  un  moyen  d'etude  rentable,  c'est-4-dlro  qu'll  ne  dolt  pas  6tre  plus 
ondreux  que  les  autres  moyens  d'etude  dlsponlbles  pour  un  travail  Identlque. 

-  I.1  effort  de  developpement  et  de  mlse  au  point  des  loglclals  -  example  le  model e  de 
mdcanlque  du  vol  -  dolt  s'lnscrlre  dans  un  contexte  plus  global  que  leur  seule  utilisa¬ 
tion  pour  la  SDVEH. 

-  Le  SDVEH  dolt  offrlr  une  bonne  dlsponlbll 1t6  at  #tre  d'un  emplol  facile  pour  ses  utlll- 
sateurs  potentials  sans  1 ' aid*  d'une  formation  specialist. 

2.2.  DEFINITION  CONCEPTUELLE  DU  SDVEH 

Les  rdsultats  de  cette  approche  condulsent  4  la  definition  conceptuelle  sulvante. 

"Un  slmulateur  de  vol  d'etude  pour  heilcoptire  est  un  moyen  d'etude  capable  de  restltuer  en  tempi 
rdel .  le  vol  vu  et  sent!  par  1  'equipage  d'un  heilcoptdre  dans  son  envlronnement  et  avec  tous  les 
moyens  d ' aide  au  pilotage  qul  sont  4  sa  disposition". 

Par  rapport  4  la  definition  Inltlale,  qul  met  1'accent.  sur  le  fonctlonnement  temps  reel  et  la 
presence  d'un  equipage,  on  volt  apparaltre  Id  les  notions  complementalres  de  "vol  vu  et  sentl", 
"d1 envlronnement",  "de  moyens  d ' aide  au  pilotage"  et  de  "moyen  d'etude". 

Les  notions  de  "vol  vu  et  sentl"  et  "d'envlronnement"  tradulsent  le  rflle  determinant,  dans  le 
comportement  d'un  equipage  d'heilcoptere,  partlculierement  en  vol  tactlquo,  d' Informations 
dlrectes  Issues  de  la  vision  du  monde  ext#r1eur  et  de  sensations  dlversps  de  vibrations  ou  acce¬ 
lerations. 

En  offet,  le  vol  tactlque  tel  que  le  pratique  1'Armee  de  Terre  Frangalse,  conslste  a  voler  au 
plus  pres  du  sol  (hauteur  de  vol  de  quelques  metres  ou  dljalnes  de  metres  au  maximum)  on  explol- 
tant  le  relief  et  la  vegetation  pour  echapper  aux  moyens  de  detection  ennemls.  Au  cours  d'un  tel 
vol,  les  obstacles  4  evlter  sont  nombreux  et  varies  (arbres,  cSbles,  pyldnes,  falalse,  etc  ,,.) 
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Le  seul  moyen  de  surmonter  toutes  css  dlfflcultfts  pour  I'fiqulpage,  consists  actuellament  a  ob¬ 
server  constamment  1 'environnement  exterieur,  pour  dfeflnlr  et  contrO'ler  une  trajectoire  de  vol 
entre  1 es  obstacles. 

La  simulation  d'une  telle  vision  de  1 'environnement  exterieur  pose  de  nombreux  probllmes  et  dif¬ 
ference  radical ement  un  slmulatour  Hillcopttre  d'un  slmulateur  Avion. 

Par  atlleurs,  11  Importe  pour  le  SDVEH  de  ne  pas  nlgllger,  I  priori,  des  Informations  qul  peuvent 
se  rfivSlar  declslves  dans  le  compo<”tement  de  1  Equipage  S  1 'occasion  de  oertalnes  etudes  et  done 
Indlspensables  pour  vallder  les  resultats. 

Cette  remarque  Stabllt  la  difference  qul  axlste  entre  un  slmulateur  d'etude  et  un  slmulateur 
d'entralnement  qul  vise  a  entretenlr  ou  dlvelopper  une  aptitude  pour  laquelle  eertalnes  "sim¬ 
plifications'1  sont  admlsslbles, 

La  notion  "de  moyens  d 'aide  au  pilotage"  tradult  la  nficesslte  de  replacer  I'lqulpage  dans  un 
environnement  cablne  trSs  proche  de  la  rdallte  pour  1 'analyse  du  comportement  de  1 'equipage  dans 
la  satisfaction  de  eertalnes  fonctlons,  en  particular  le  pilotage. 

tin  outre,  la  notion  "d'equlpage"  est  malntenue  car  actual  lament  aucune  mission  helicopters  n'est 
envisages  sans  une  etrolte  collaboration  de  deux  dqulplers  au  molns. 

La  notion  de  "moyen  d' etude"  tradult  la  nicesslte  pour  le  SDVEH  d' avoir  un  caractlre  plural  Is te 
dans  sos  appllcctlcns  et  d'etre  capable,  en  partlculler,  d'une  Integration  potentlello  »  un 
systbme  d'arme  en  prevoyant  dlverses  relations  et  la  presence  de  fonctlons  speclflques, 

Le  schema  sulvant  resume  la  definition  etablle.  L1  Integration  potential^  d'un  systeme  d'arme 
est  illustree  par  different:  sous-ensembles  et  relations  en  pointllie. 
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2.3.  SPECIFICATIONS  MISE  EN  OEUVRE 

De  plus,  des  specifications  da  mise  en  oeuvre  ont  dte  retenues  : 

-  Le  slmulateur  dolt  offrlr  une  bonne  flabllite  at  malntenabillte 

-  Les  moyens  de  dialogue  entre  le  SDVEH  et  *on  utl'lisateur  doivent  6tre  souples,  varies  et 
banal  isfis.  La  proprammation  se  fera  dans  un  langage  de  haut  niveau 

•  Le  Loglclel  dolt  etre  utlllsable  pour  d'autres  applications  temps  real  ou  non 

-  L'organlsatlon  du  slmulateur  dolt  8tra  modulaire. 

3.  CONTRAINTES  DU  PROJET 

La  realisation  d'un  projet  ast  toujours  soumlse  &  des  oontralntes  extdrleures,  Pour  le  SDVEH,  trols 
contralntes  majeures  ont  6t4  prises  en  compte  : 

-  Concevolr  un  plan  de  diveloppement  du  SDVEH  qul  permette  de  l'utlllser  a  court  terme  dans  le  cadre 
de  programmes  ou  projets  er,  cours 

-  Limiter  les  coOts  de  developpoment  du  SDVEH  en  exploitant  en  priorlte  les  moyens  materiel s  de  simu¬ 
lation  du  Centre  d'Essais  en  Vol  d'lstres 

-  Cholsir  des  moyens  matfirlels  qul  s'hamionisent  parfaltement  avec  ceux  des  dlffdrents  utlllsateurs 
po1  antiels. 

Cecl  Influe  en  partlculier  sur  1 'architecture  g6n6r»le  du  slmulateur  et  sur  le  cholx  des  moyens 
Informatlques,  pSrlpherlques  associds  et  dlverses  Interfaces. 

4.  ORGANISATION  GENERALE  ET  PROGRAMME  OE  DEVELOPPEMCNT 
4.1.  ORGANISATION  FONCTIONNELLE  ET  ORGANIQUE 

Les  conclusions  de  l'enalyse  preilmlnalre  et  des  contralntes  exposdes  permettent  de  ddflnir  une 
premlbre  organisation  fonctionnelle  et  organique  du  SDVEH.  (Voir  schfima  Planche  2)  Installie 
au  Centre  d'Essais  en  Vol  d'lstres. 

Sur  le  plan  organique,  on  distingue  quatre  sous-ensembles  prinelpaux  ; 

-  la  cabi  >t  tous  les  instruments  d' Interface  des  postes  d'equlpage, 

-  1 'unite  1m  rfffliatlque, 

-  le  systeme  de  restitution  de  la  vision  du  monde  extSrieur, 

-  la  plateforme  de  mise  en  mouvement  de  la  cablne. 

-  La  plateforme  de  mise  en  mouvement  de  la  cablne  doit  partlclper  a  la  restitution  d'une  ambiance 
de  vol  aussl  proche  que  possible  de  celle  d'un  vol  reel,  en  simulant,  en  pnrticulier  des  sensa¬ 
tions  d'accSUratlon. 

La  plateforme  cholsle  est  une  plateforme  LMT  a  6  degrds  de  libsrte.  Son  mouvement  est  du  type 
aralgnbe  a  6  vbrins.  Les  dbhattements  maxlmaux  sont  de  ±  1,6  m.  E 11 e  peut  supporter  une  charge 
Je  10  tonnes  et  recevolr  une  sphere  de  visualisation. 

-  La  cablne,  quant  a  l'organlsatlon  des  postes  d'equlpage,  est  le  r&sultat  d'un  maquettage 
dynamlque  pousse  i  el  1  e  est  la  rftpllque  exacte  d'une  cablne  d'heiicoptere,  equipde  d'lnstru- 
ments  et.  command**  d'interface  reels  ou  non,  capables  d'un  fonctlonnement  Simula.  El  1  e  permet 
des  reorganisations  dos  postes  d'equlpage  a  l'occa'iun  de  difffirentes  etudes, 

La  restitution  des  efforts  aux  commandes  de  vol  est  prfivue.  La  presence  possible  de  ,deux 
membres  d'equlpage  necassite  une  etude  particuliere  qy 1  doit  conciller  Its  points  suivants 
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pour  les  objectlfs  d'etude  cholsls  :  configuration  de  la  cablne  et  de  l'equlpage,  Importance 
de  la  vision  exterleure  jour  et  nult  pour  les  deux  niembres  d'equlpage  et  possibility  de  resti¬ 
tution  pour  chacun  d'eux.  Les  conclusions  permettent  de  falre  un  cholx  entre  une  cablne  biplace 
ou  deux  cablnes  monoplaces.  Dans  ce  dernier  cas,  une  synchronisation  des  deux  cabinet  est 
nficessalre  pour  la  restitution  de  la  vision  du  monde  exterleur  et  plus  general ement  pour  toutes 
les  Informations  presentes  aux  deux  postes  d'equlpage. 

Le  systeme  de  restitution  de  la  vision  du  monde  exterleur  comprend  deux  sous-ensembles  prlncl- 
paux  :  le  sous-ensemble  de  generation  de  1 'Image  «t  le  sous-ensemble  de  visualisation  aux 
postes  d'equlpage. 

Le  systeme  global  permet  principal ement  de  slmuler  pour  un  vol  tactlque,  la  vision  exterleure 
directs  dont  dispose  1  'equipage  en  vol  de  jour  et  une  vision  du  monde  exterleur  i  base  de 
camera  Infra-rouge  dans  le  cas  du  vol  de  nult.. 

II  paratt  difficile  de  couvrlr  ces  deux  cas  avec  les  mimes  moyens  techniques.  De  plus,  la  pre¬ 
sence  possible  de  deux  membres  d'equlpage  compllque  serleusement  le  probieme  dans  la  mesure  oO 
en  particular  leurs  utilisations  respectlves  do  la  vision  exterleure  peuvent  Itre  totalement 
Independantes  et  parfols  contradlctolres,  Comptc-tenu  de  ces  dlfflcultes  et  du  rile  determinant 
de  ce  systeme  dans  le  SDVEH,  11  Importe  d'adopter  a  son  egard  une  organisation  trfts  moduUIre 
permettant  de  le  modifier  en  fonctlon  des  etudes  et  de  le  faire  evoluer  en  fonctlon  des  pro- 
gres  a  venlr  dans  ce  domains. 

Les  moyens  de  calcul  temps  reel  sont  organises  autour  de  calculateurs  type  SEL  32  travalllant 
sur  32  bits  flottants. 

Afln  d'atteindre  les  objectlfs  fixes,  le  Loglciel  dolt  &tre  congu  de  fagon  trls  modulalre. 

En  outre,  11  est  ecrlt  en  FORTRAN  afln  d 1 en  rendre  la  manipulation  trls  facile. 

Le  module  de  mOcanlque  du  vol  dolt  6tre  programmable  en  fonctlon  de  1  'heilcoptftre  etudie.  II 
est  capable  de  restltuor  le  comportement  du  venlcule  dans  tout  le  domalne  de  vol  tactlque. 
C'est-a-dire  : 

-  aux  basses  vltesses 
aux  fortes  Incidences 

-  aux  forts  derapages 

-  dans  1  'effet  de  sol . 

Le  module  du  pllote  automatlque  doit  Itre  Interchangeable  on  fonctlon  de  I'heilcoptlre  ou  du 
pllote  automatlque  slmuie. 

Le  Loglciel  comprend  egalement  une  sdrie  de  modules  modeiisant  tout  ou  une  partle  des  Cqulpe- 
ments,  capteurs  et  commandes  de  vol. 

De  plus,  ''Integration  d 'ARRAY -PR0CES3EUR  est  possible  afln  d'augmenter  la  puissance  de  calcul 
temps  reel  du  systeme,  en  particular  pour  la  simulation  dn  parties  complexes  d'un  systeme 
d'arme. 

Le  couplage  des  moyens  Informa tlques  4  une  liaison  du  type  BUS  numSrl que  embarque  est  possible. 
Cecl  amei lore  les  posslbllltes  d' integration  d'equipsments  reels  au  seln  du  SDVEH. 

Les  moyens  peripheries  sulvants  sont  prfivus  pour  faclllter  1'exploltatlon  des  essals  : 

-  1  console  graphlque  et  alpha  numeriquo 

-  1  Imp'-lmante 

-  1  lecteur  de  cartes 

-  Plusleurs  dlsques  de  80  M6ga  octets  pour  le  stackage  des  programmes  et  des  flchlers 

-  Des  bandes  magn6t1ques  de  800  et  1600  BP I  pour  une  vitesse  de  defilement  de  75  IPS 

-  1  processtur  generateur  capable  d'elaborer  une  symbol  ogle  superposable  4  une  Image  video 
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-  Des  ecrans  TV  de  contrflle  de  la  vision  du  monde  extdrleur  aux  postes  d'fiqulpage 

-  Divers  Instruments  Identlques  i  ceux  Installds  aux  pottos  d'equlpage. 

-  Des  sous-ensembles  sont  prdvus  pour  restltuer  les  vibrations  et  une  amblancu  sonore  en  parti- 
culler. 

-  Sur  le  plan  fonctlonnel,  on  ramarque  1«  carnctire  anthopocentrlque  du  slmulateur  at  son  soucl 
de  replacer  I'lqulpage  dans  une  ambiance  aussl  proche  qua  possible  de  celle  d'un  vol  reel  en 
envlsageant  tous  las  types  de  perception  auxquels  11  ast  soumls,  sachant  qu'oUes  Jouent  un  rOle 
ddclslf  dans  le  comportament  d'un  equipage  d'hdllcoptire. 


On  observe  enfln  la  posslblllte  d'un  "fonetlonnement  slmpllfie"  du  SDVEH,  sans  systeme  de  resti¬ 
tution  du  monde  extdrleur  et  sans  plateforme  de  wise  en  mouvenwnt.  11  peut  ttre  utilise  de  deux 
fa go ns  dlffdrentes  : 

-  Tout  d'abord,  lors  de  la  mlse  au  point  du  SDVEH 

-  Puls  en  exploitation  normals  du  si.rulateur  pour  rddulre  le  temps  d1  Immobilisation  de  1 'ensemble 
des  moyens  de  simulation  Implantes  au  Centre  d'Essals  en  Vol  d'Istres. 

En  effeti  ce  fonetlonnement  ne  met  an  Jeu  qua  des  sous-ensembles  transpr.rtables  -  le  Loglclel  et 
la  cabins  (appelfis  pour  cette  raison  Unite  Mobile  d* Etude)  -  Tamils  que  les  systems*  de  restitu¬ 
tion  de  la  vision  extdrleure  et  de  mlse  en  mouvement  sont  fixes.  Installs  I  demeure  ft  Istre3 
(Unite  Lourde  d' Etude). 

II  sera  done  possible  da  mleux  preparer  une  experimentation  avant  de  se  presenter  t  Istres,  De 
plus.  11  sera  possible  de  mener  allleurs  qu'l  Istrus  certalnes  etudes  pour  lesquellas  la  presence 
des  moyens  fixes  n'est  pas  Indispensable. 

Ce  fonetlonnement  dolt  amellorer  la  rentablllte  du  SDVEH. 

4.3.  PROGRAMME  DE  PEVELOPPEHENT 

Compte-tenu  du  caractere  ftvol utlf  d'un  slmulateur  d'etude  et  de  l'lnteret  de  le  doter  das  plus 
recants  progrds  techniques  susceptlbles  d'Stendre  son  champ  d'apnl Icatlon,  11  a  e*ft  cholsl  de 
sulvre  un  plan  de  developpament  du  projet,  progresslf  et  respectant  des  Stapes  cies. 

Ce  plan  de  dfiveloppement  prevolt  deux  phases,  elles-mSmes  dlvlsdes  en  processus  (voir  Planche  4). 
La  pramitre  phase  a  un  caractftr#  d'etude  tandls  que  la  deuxlftme  est  une  phase  de  realisation  du 
SDVEH  qul  n'est  lancfie  qu'aprSs  analyse  des  rftsultats  dn  la  premiere  phase  et  evaluation  des 
coQts. 

4.3.1.  Phase  1 

La  premiere  phase  est  une  phase  de  definition  et  de  conception  du  SDVEH  qul  dure  douse 
mols.  Ella  comprend  trols  processus  ; 

-  Processus  1  FAISABILITE 

-  Processus  2  DEFINITION 

-  Processus  3  CONCEPTION 

-  Le  premier  processus  dolt  permgttre  de  s'assurer  de  la  falsabilite  et  de  la  definition 
genera's  du  contenu.  de  certains  sous-ensembles  du  SDVEH  en  function  des  objectlfs  et 
des  contralntes  cites . 

Elle  dolt  4gal*ment  prdclser  la  fagon  de  valider  lo  slmulateur  et  ses  sous-ensembles. 

Les  resultats  de  ce  processus  sont  fondamentaux  :  11s  dftflnlssent  les  posslbllltes 
futures  d'etude  du  slmulateur  et  son  contenu  materiel. 
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Le  deuxISme  processus  est  1  'Stablissement  du  cehler  des  charges  dn  SOVEH,  fixant  pr#c1- 
stment  les  fonctlons  de  chaque  sous-enscmble  et  les  ^changes  entre  eux. 


-  Le  trolsISme  processus  est  Vstabl issement  des  spficitications  techniques  et  des  Masses 
de  plans  pour  entreprendre  la  rdalisation  effective  du  SDVEH  db»  le  notification  de  la 
phase  sulvante. 

4,3.2.  Phase  2 

La  deuxISme  phase  est  uno  phase  de  rialisstion  exploltant  les  rSsultats  de  la  Phase  1 
s'Hs  sont  dSfinitlvement  acceptls.  El  le  dure  24  mol s  et  comprend  deux  processus  t 

-  Processus  1  DEVELOPPEMENT  MISE  EH  OEUVRE  DES  DIFFERENTS  SOUS-ENSEMBLES 
*  Processus  2  INTEGRATION 

-  Le  premier  processus  est  consacrS  1  la  realisation  concrete  des  difftrents  sous-ensembles 
et  I  leur  contrOle  sur  les  lieux  de  fabrication. 

-  Le  deuxISme  processus  privolt  1 'assemblage  au  Centre  d'Essals  en  Vol  d'Istres,  des  dif- 
fSrents  sous-ensembles  aprSs  avoir  vftrifiS  leur  bon  fonctlonnement  Individual.  II 
comprend  Sgalement  le  contrile  de  bon  fonctlonnement  de  1 'ensemble. 

6,  POINTS  CRITIQUES 

Ce  projet  de  SDVEH  fait,  apparaltre  un  certain  nombre  de  points  jugSs  critiques  pour  l'avenir  d'un  tel 
simulateur. 

1  Le  restitution  de  la  vision  du  monde  extSrleur  est  essentielle,  notamment  pour  1 'Studs  du  vol 
tactique.  La  quality  avec  laquelle  ell e  est  restitute  dst'inlt  dans  une  large  mesure,  I'intSrBt  du 
SDVEH.  l,e  cas  de  la  vision  de  jour  paralt  le  plus  ddlicat  4  trait.er, 

2  Le  module  de  mScanique  du  vol  doit  Gfcre  capable  de  restituar  en  temps  riel  le  comportement  du 
vShlcule  dans  le  domalne  de  vol  trSs  variS  du  vol  tactique. 

3  La  restitution  des  efforts  aux  commandes  do  vol  doit  Dtre  rSaliste  si  1 'on  ne  veut  pas  dSsorianter 
les  Squipages. 

4  Les  mouvements  de  la  plateforme  supportant  la  cabine  dolvent  Stre  reprSsentatifs  at'in  de  ne  pas 
fournir  4  VSquipage  une  fausse  Information  plutfit  de  nature  4  la  troubler  qu'4  le  rense^gner. 

5  Enfin,  on  ne  dolt  pas  perdre  de  vue  qua  sans  une  bonne  aptitude  aux  reconfigurations  et  4  1' in¬ 
tegration  d'un  systeme  d'arme,  .le  SDVEH  volt  son  utilit#  rSduite. 

6.  CONCLUSION 

En  conclusion,  un  tel  projet  rSsulte  de  la  ndcessItS  de  se  doter  pour  les  annSes  4  venir,  de  moyens  d'Stude 
adapts*  pour  rSsoudre  4  temps  les  problSmes  que  posent  principalement  l'avionique  dans  le  rfiveloppe- 
ment  d'un  nouveau  programme  ou  projet  HSIicoptire. 
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COST-EFFECTIVENESS  OF  FLIGHT  SIMULATORS  FOR  MILITARY  TRAINING 


Jesse  Grlansky  arid  Joseph  String 
Institute  for  Defense  Analyses 
Arlington,  Virginia  22202 


SUMMARY 


Tha  cost  and  effectiveness  of  flight  simulators  used  for  military  training  are  evalu¬ 
ated  In  this  paper.  An  analysis  of  recent  cost  data  shows  that  modern1  flight  simulators 
can  be  operated  at  costs  that  range  from  about  R  to  20  percent  that  of  comparable  air¬ 
craft.  with  respoct  to  effectiveness,  many  studies  show  that  skills  learned  In  flight 
simulators  can  be  performed  successfully  In  aircraft!  this  finding  applies  to  a  wide  va¬ 
riety  of  tasks,  aircraft,  types  of  simulators  and  level  of  pilot  training.  Using  the 
Transfer  Effectiveness  Ratio  as  a  basis  of  comparison,  It  appears  that  pilots  trained  In 
simulators  use  lass  flight  time  to  perform  various  tasks  than  do  those  trained  only  In 
aircraft;  the  median  amount  of  flight  time  saved  Is  about  half  of  the  time  spent  In  the 
simulator.  There  Is  a  wide  variation  In  the  amounts  of  flight  time  saved  but  the  reasons 
for  this  variation  have  not  been  studied.  Thus,  the  critical  Issue  Is  whether  tha  amount 
of  aircraft  time  saved  Is  worth  the  cost  of  the  use  of  simulators.  The  cost-effectiveness 
of  flight  simulators  for  training  has  been  examined  only  In  a  few  recent  studies!  these 
show  that  the  procurement  cost  of  simulators  can  be  amortized  In  about  two  years.  Cur¬ 
rent  research  and  development  on  flight  simulators  center  about  the  need  for  motion  and 
wide  angle  visual  display  systems. 

1 .  INTRODUCTION 


"I  have  always  considered  the  present  method  of  doing  all  the  training  on  planee  ae 
entirely  too  elou  and  too  expensive.  There  are  certain  thinge  which  the  pilot  mutt  do  by 
reflex  notion  without  aonaoioue  effort.  From  my  experienoe  in  teaohing  years  ago  I 
found  these  things  oould  be  done  better  and  more  quiokly  on  the  ground.  .  .  More  train¬ 
ing  in  overooming.  .  .acquired  reflex  aatione  (e'.g,,  controlling  the  airoraft  rudder  in  a 
manner  opposite  to  steering  a  sled)  oan  be  had  in  one  minute  on  a  ground  trainer  than  oan 
be  had  in  an  hour  in  an  inherently  stable  aeroplane  such  ae  is  used  today  in  training." 

Letter  from  Orville  Uright  to  Charles  F,  Kettering ,  Mcroh  11,  1841, 

(McFarland,  1872,  p.  1167-1168 1, 

Flight  simulators  have  been  available  for  almost  as  long  as  there  have  been  aircraft. 
For  example,  the  Sanders  Teacher  could  be  used  far  training  pilots  In  England  In  1910, 
about  70  years  ago  (Figure  1).  Modern  flight  simulators,  with  wide  angle  visual  systems 
and  moving  platforms  are,  of  course,  much  more  complex  training  devices,  This  paper  eval¬ 
uates  what  Is  known  about  the  cost  and  effectiveness  of  flight  simulators  used  for  mili¬ 
tary  training.* 

A  flight  simulator  can  best  be  viewed  as  a  training  device.  It  permits  close  obser¬ 
vation  of  pilot  performance  and  immediate  feedback  and  thereby  Improves  learning!  It  can 
train  pilots  In  many  types  of  malfunctions  not  often  encountered  In  flight!  It  is  safe 
and  permits  training  Independent  of  weather,  air  traffic  and  the  availability  of  aircrafts 
it  saves  fuel,  ammunition,  targets,  wear  end  tear  on  airplanes  and,  above  all,  the  lives 
of  pilots.  But  a  simulator  also  has  some  Important  disadvantages.  Even  the  most  advanced 
simulators  have  limited  fidelity  In  their  external  vision,  platform  motion  and  flight 
aquations;  they  cannot  provide  the  stress  and  motivation  possible  only  In  actual  flight; 
and  they  are  expensive  to  procure  and  to  operate. 

The  use  of  flight  simulators  has  Increased  markedly  in  the  United  States  since  the 
oil  embargo  of  1973;  about  $300  million  will  be  spent  for  procurement  In  Fiscal  Vear 
1979  and  about  $500  million  In  Fiscal  Year  1980. 

2.  COST  OF  OPERATING  FLIGHT  SIMULATORS  AND  AIRCRAFT 

Tha  first  question  about  the  use  of  flight  simulators  and  aircraft  for  training  con¬ 
cerns  how  much  each  cost  to  operate.  For  this  purpose,  we  consider  only  "variable 
operating  costs"  which,  by  definition.  Include  the  costs  of  fuel,  oil  and  lubrication, 
base  maintenance  materials,  and  that  portion  of  depot  maintenance  which  varies  with  fly¬ 
ing  hours  and  replenishment  spares.  Variable  operating  costs  do  not  Include  the  costs  of 
crew  and  student  salaries  or  of  amortizing  the  purchase  of  simulators.  We  were  able  to 
find  data  on  operating  ccsts  per  hour  for  33  aircraft  and  simulators,  as  shown  In  Figure 

2.  The  data  are  based  on  actual  utilization  of  aircraft  and  simulators  In  FY  1975  and 

FY  1976. 

In  absolute  terms,  the  costs  of  operating  simulators  range  from  about  $10  to  $275 
per  hour;  the  costs  of  operating  aircraft  range  from  about  $60  to  $3600  per  hour.  For 

the  same  aircraft,  the  ratios  of  simulator/aircraft  operating  cost  vary  from  about  5  to 


*This  study  was  performed  for  the  Deputy  Director  of  Defense  Research  and  Engineering 
(Research  and  Advanced  Technology),  United  States  of  America. 
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20  parcent,  Tht  median  value  Is  about  12  percent.  Thus,  It  Is  clear  that  It  costs  less 
to  operate  a  flight  simulator  than  the  comparable  aircraft,  This  finding  Is  not  a  surprise. 
The  cost  advantage  of  flight  simulators  says  nothing  about  their  effectiveness  for  training. 

3.  THE  EFFECTIVENESS  OF  FLIGHT  SIMULATORS 

One  way  to  evaluate  the  effectiveness  of  a  flight  simulator  Is  to  ask  experienced 
pilots  to  judge  whether  that  simulator  files  about  the  same  way  the  actual  airplane 
does.  This  Is  the  test  of  "fidelity  of  simulation".  Since  we  ware  concerned  with  the 
use  of  flight  .simulators  for  flight  training,  we  were  particularly  Interested  In  whether 
skills  learned  In  a  simulator  carry  over  to  an  airplane.  That  Is  called  "transfer  of 
training",  which  Is  defined  below.  For  our  purposes,  we  wanted  to  know  how  well  pilots 
trained  In  simulators  perform  the  same  tasks  In  the  «1r  compared  to  those  trained  only  In 
aircraft.  We  also  wanted  to  know  whether  training  In  simulators  saves  any  flight  time. 

There  are  33  studies  performed  from  1939  to  1977  which  provide  Information  relevant  to 
these  Issues. 

The  simulators  used  In  these  studies  varied  widely  with  respect  to  types  of  aircraft, 
visual  and  motion  systems:  about  half  the  studies  were  performed  after  1970  when  more 
modern  simulators  began  to  be  available.  The  pilots  used  In  these  studies  vary  with  res¬ 
pect  to  level  of  experience:  a  wide  range  of  flying  tasks  were  employed,  These  studies 
show  that  pilots  trained  In  simulators  perform  In  aircraft  as  wall  as  those  trained  only 
In  aircraft,  at  least  as  measured  by  Instructor  Pilot's  ratings.  This  finding  applies 
generally  to  such  tasks  as  cockpit  checkout,  flight  procedures,  Instrument  flying,  take¬ 
off  and  landing:  a  few  recent  studies  extend  these  findings  to  more  acrobatic  maneuvers 
and  to  air-to-ground  gunnery,  Simulator  training  also  seems  to  save  flight  time. 

However,  the  results  of  these  studies  are  not  reported  in  a  common  format  whloh  per¬ 
mits  one  to  generalize  on  how  much  flight  time  can  be  saved  by  simulators,  The  Transfer 
Effectiveness  Ratio  (TER},  as  deflnad  in  Figure  3,  can  be  used  to  show  the  amount  of 
flight  time  saved  es  a  function  of  tht  amount  of  time  spent  on  training  the  same  task  In 
a  simulator.  Its  use  for  comparative  evaluation  was  proposed  by  Stanley  Roscoa  (1971)  In 
1971 . 


Mott  studies  of  flight  training  In  simulators,  Including  the  more  recent  ones,  do 
not  report  Transfer  Effectiveness  Ratios,  However,  enough  Information  was  available  In 
22  studies  from  1967  to  1977  to  compute  the  34  TERs  shown  In  Figure  4,  These  TERs  apply, 
variously,  to  Instrument  training,  transition  training,  flight  procedures,  simulators 
with  or  without  motion  and  so  on.  Overall,  the  TERs  vary  from  -0,4  to  1.9,  with  a  median 
value  of  0.40.  This  may  be  Interpreted  as  follows: 

Pilots  trained  In  simulators  use  less  flight  time  than  those  trained  only  In  aircraft. 
Tht  median  amount  of  flight  time  saved  Is  about  half  (0.48)  of  the  time  spent  In  the  sim¬ 
ulator.  Thera  Is  one  negative  value  (-0.4)  which  means  that  pilots  trained  In  a  simula¬ 
tor  In  that  study  used  more  aircraft  time  than  those  trained  only  In  aircraft.  This 
finding  has  not  been  confirmed  and  there  Is  Insufficient  Information  with  which  to  ex¬ 
plain  this  cast  of  "negative  transfer":  It  may  be  due  to  use  of  an  Inadequate  simulator. 

In  any  cast,  It  Is  helpful  to  understand  that  not  all  uses  of  flight  simulators  necessar¬ 
ily  save  training  time. 

There  are  seven  cases  where  the  TER  Is  one  or  moro.  These  cases  mean  that  more  than 
one  hour  of  flight  time  was  saved  for  every  hour  spent  In  the  simulator,  This  result 
should  not  be  too  surprising.  It  Is  possible  to  practice  e  task  more  often  In  an  hour 
In  a  simulator  than  In  an  aircraft:  e.g.,  one  doesn't  have  to  go  around  the  traffic  pat¬ 
tern  to  shoot  a  landing:  one  doesn't  have  to  take  time  to  set  up  a  flight  condition  as 
In  an  airplane,  because  It  can  be  set  up  Instantly  by  the  computer:  one  can  get  more  feed¬ 
back  about  performance  In  a  simulator  than  In  an  airplane,  and  so  on. 

However,  the  high  positive  TERs  and  the  one  negative  TER  are  extrema  values:  the 
middle  50  percent  of  all  values  fall  between  0.25  and  0.75:  the  median  TER  of  tho  entire 
distribution  Is  0.48. 

The  TERs  shown  previously  were  divided  Into  three  groups  based  on  the  experience 
level  of  the  pilots  which,  In  effect,  also  describe  the  use  of  simulators  for  different 
types  of  training: 


Level  of  Experience 
highly  experienced 

graduate 

undergraduate 


Type  of  Training 

transl tlon 
flight  procedures 

transl tlon 
Instrument 

farnl  1  larlzatlon 
Instrument 


As  shown  In  Figure  5,  undergraduate  pilots  trained  In  simulators  for  familiarization 
and  Instrument  flying  save  more  aircraft  time  than  more  advanced  pilots  trained  In  simu¬ 
lators  for  transition  flying  and  flight  procedures.  However,  It.  costs  more  per  hour  to 
fly  an  advanced  aircraft  than  one  used  by  undergraduate  pilots,  but  that  Is  not  consider¬ 
ed  here. 


In  i  recent  study,  Tranffer  Effectiveness  Ratios  were  determined  for  JM  different 
maneuvers  when  the  CH-47  helicopter  flight  simulator  was  used  for  transition  training 
(Holman,  1979).  The  findings  (Figure  6)  show  that  the  effectiveness  of  this  simulator 
for  training  varies  widely  among  the  maneuvers  for  which  It  was  used  In  this  study.  The 
TERs  range  from  0.0  to  2,8.  Clenrly  this  simulator  should  not  be  used  for  training  on 
certain  maneuvers.  It  appears  that  this  circulator  has  limitations  for  training,  probably 
for  tasks  that  depend  significantly  on  visual  simulation. 

Based  on  tnese  studies,  the  effectiveness  of  flight  simulators  may  be  summarized  as 
follows: 

1  *  Simulators  are  effective  for  training  pilots  under  many  different  conditions. 
Simulators  have  been  shown  to  be  effective  for1  training  'undergraduate  and  graduate  pilots, 
for  training  on  many  different  types  of  aircraft,  end  for  training  on  different  types  of 
tasks  (e.g.,  landing,  instrument  flight,  flight  procedures,  flight  familiarization)'. 

This  finding  also  applies  generally  to  the  effectiveness  of  simulators  with  a  variety  of 
performance  capabilities,  e.g.,  with  or  without  vision,  with  or  without  motion. 

2.  Effectiveness  varies. widely.  There  Is  a  wide  range  In  the  dtgrae  of  effective¬ 
ness  reported  With  the  use  of  flight  simulators;  Little  systematic  attention  has  been 
given  to  examining  the  factors  that  may  Influence  the  effectiveness  of  simulators.  Since 
most  studies  do  not  use  common  measures,  It  Is  difficult  to  understand  the  rtesons  for 
the  wide  range  In  the  effectiveness  of  different  types  of  simulators  or  in.  thf-lr  use  for 
training  on  different  tasks. 

3.  Flight  simulators  save  aircraft  time.  Virtually  all  studies  (21  out  of  22)  ,sh<»w 
that  the  use  of  flight  simulators  saves  aircraft  time.  Pilots  trained  on'  specific  tasks 
In  simulators  nead  less  time  to  perform  these  tasks  In  aircraft  than  do  pilots  trained  on 
the  same  tasks  only  In  aircraft. 

4.  Effectiveness  does  not  Imply  cost-effectiveness,  The  fact  that  flight  simulators 
are  effective  for  training  does  not  necessarily  Imply  that  they  are  worth  whet  they  cost 
to  operate. 

Me  turn  next  to  the  question  of  the  cost-effectiveness  of  flight  simulators. 

4 .  COST-EFFECTIVENESS  OF  FLIGHT  SIMULATORS 

In  order  to  estimate  the  cost-effectiveness  of  flight  simulators  for  training,  we 
need  data  on  the  cost  and  the  effectiveness  of  simulators  and  of  aircraft  for  training 
pilots  on  particular  maneuvers  or  tasks,  Such  data  have  been  reported  In  only  a  few 
studies. 

A  study  by  Povenmlre  and  Roscoe  (1973)  shows  exactly  how  the  cost-effactlvaness  of 
a  flight  simulator  should  be  evaluated.  Student  pilots  were  given  either  0,  3,  7,  or 
11  hours  of  training  on  the  Link  GAT-1  simulator  before  being  trained  in  an  airplane. 
Figure  7  shows  the  number  of  hours  needed  by  each  group  to  pass  the  final  flight  check, 
and  the  number  of  aircraft  hours  saved  by  the  simulator  when  compared  to  hours  needed  by 
those  trained  only  In  the  airplane.  To  the  best  of  our  knowledge,  tills  Is  the  only  study 
performed  so  far  In  which  the  amount  of  time  spent  In  a  simulator  was  varied  systematical¬ 
ly}  all  other  studies  tend  to  use  a  fixed  amount  of  simulator  time. 

Figure  8  shows  the  Cumulative  Transfer  Effectiveness  Ratio  and  the  Incremental  Trans¬ 
fer  Effectiveness  Ratio  as  functions  of  the  amount  of  t<me  spent  In  the  simulator  (CTER 
Is  the  same  as  TER).  Both  ratios  are  reduced  as  the  amount  of  time  spent  In  the  simulator 
Increases.  This  Is  an  important  finding  because  It  permits  us  to  determine  when  the  mar¬ 
ginal  transfer  effectiveness  of  the  simulator  has  been  reached.  A  useful  criterion  Is 
the  ratio  of  the  coses  of  operating  a  particular  simulator  and  aircraft.  In  this  case, 
the  slmul ator/al rcra Ft  operating  cost  ratio  Is  $16/22  pnr  hour  or  0.73,  Therefore,  train¬ 
ing  In  the  simulator  Is  cost-effective  until  the  Incremental  Transfer  Effectiveness  Patio 
drops  below  the  simulator/aircraft  operating  cost  ratio.  This  occurs  at  about  4  hours  In 
the  GAT-1  when  It  Is  used  for  training  student  pilots  to  pass  the  final  flight  check  for 
a  private  pilot's  license. 

The  Piper  Cherokee  Is  a  simp's  airplane  and  It  Is  Inexpensive  to  operate,  t.e., 

$22  per  hour.  Many  military  aircraft  cost  far  more  to  operate  and,  as  reported  earlier, 
most  simulator/aircraft  operating  cost  ratios  rango  between  0.06  and  0.20.  If  thosa 
ratios  applied  to  the  present  data,  It  would  have  been  economical  to  use  the  simulator 
for  longer  periods,  perhaps  as  long  as  10  to  20  hours, 

The  Coast  Guard  operates  two  helicopters,  the  HH-62A  and  the  HH-3F  (Isley,  Corley 
and  Caro,  1974).  In  1974,  It  Introduced  the  Variable  Cockpit  Training  System.  This 
simulator  has  two  cockpits  and  can  simulate  either  or  both  helicopters;  each  has  a  motion 
base  with  six  degrees  of  freedom  but  no  visual  system.  The  procurement  cos.  was  $ 3 . 1 M 
(Figure  9);  operating  costs  of  the  simulator  are  very  much  less  thin  for  the  helicopters. 

Figure  10  shows  the  number  of  aircraft  and  simulator  hours  per  pilot  required  to  com¬ 
plete  various  types  of  training  before  and  after  Introduction  of  the  simulator.  Aircraft 
hours  required  per  pilot  were  reduced  in  all  case:..  The  total  cost  of  flight  training 
used  to  be  $3  million  per  year;  now  the  total  cost  of  flight  time  and  simulator  time  Is 
$1.6  million  per  year,  a  realized  benefit  of  almost  $1.5  million  per  yaar. 


There  Is  also  an  additional  (estimated)  benefit  because  the  simulator  Is  now  'ised 
Instead  of  the  helicopter  In  preparation  for  the  check  ride  and  emergency  procedures 
tests  In  proficiency  training.  This  Is  estimated  to  cost  $106  thousand  per  year  for  the 
simulator  but  It  avoids  costs  of  about  $1.1  million  per  year  for  the  helicopters. 

Thus,  the  procurement  cost  of  the  VCTS  can  be  amortized  In  either  2.1  years  (Figure 
11)  or  In  1.2  years,  depending  on  which  benefits  are  used  to  make  this  assessment. 

In  1977 ,  Browning,  Ryan,  Scott,  and  Smode  (  1977)  compared  the  cost  and  effectiveness 
of  two  programs  for  transition  training  of  Naval  pilots  to  fly  the  P-3C,  a  four-engine 
turboprop  aircraft  used  In  anti-submarine  warfare.  The  two  programs  Involve  the  use 
either  of  an  old  simulator  (2F£9D )  or  a  new  one  (2FB7F);  both  simulators  provide  Individ¬ 
ual  end  crew  training  for  the  pilot,  co-pilot  and  flight  engineer.  The  same  cockpit  pro¬ 
cedures  trainer  ( 2C45 }  Is  used  In  both  programs.  These  devices  are  described  below: 

•  Cockpit  Procedures  Trainer.  Device  2C4S.  Provides  training  In  power  plant  manage- 
ment  and  systams  procedures  for  normal  and  emergency  operations.  This  device  Is 
ectually  an  obsolete  P-3  operational  flight  trainer  from  which  flight  dynamics, 
motion,  and  unheeded  systems  have  been  removed. 

•  Operational  Flight  Trainer.  Device  2FS9P,  This  trainer  is  a  solid  state  analog 
device  (1966  era)  which  simulates  flight  dynamics,  flight  systems,  navigation,  and 
communications  for  P-3A/B  aircraft.  It  provides  motion  (3  degrees  of  freedom)  but 
no  visual  simulation. 

•  Operational  Flight  Trainer.  Device  2FB7F .  -his  trainer  Is  a  digital  device  which 
simulates  the  P-3C  Orion  aircraft.  lF”pVov1d§s  motion  (6  degrets  of  freedom)  and 
vision  ( 60°  wide  x  38°  high)  by  means  of  a  TV  model  board  system  (IS  nml  x  5  nml) 
for  low-altitude  maneuvers  such  as  takeoff,  landing,  and  Instrument  approaches. 

It  replaces  the  2F69D. 

All  pilots  were  newly  designated  first-tour  Naval  Aviators  who  possessed  Standard 
Instrument  Cards,  All  had  completed  undergraduate  mul tl-engl nit  training  on  the  S-2,  a 
small,  two-engine  propeller-drlvan  aircraft.  Hours  given  to  training  In  simulators  prior 
to  flight  are  shown  In  Figure  12:  22  hours  In  the  old  program,  40  In  the  new  one.  After 

training  in  the  simulator,  performance  was  measured  In  the  aircraft  on  20  of  the  45 
tasks  specified  In  the  Familiarization  and  Instrument  phase  of  transition  training, 

(e.g.,  engine  start,  brake  fire,  abort  take-off,  approach,  three  engine  landing).  The 
critical  data  were  the  hours  required  by  each  group  to  perform  these  tasks  proficiently 
In  the  aircraft,  1 . • . ,  as  Judged  acceptable  by  the  Instructor  Pilot.  The  control  group 
required  IB  hours  In  the  aircraft  per  pilot,  the  experimental  group  required  9.  There 
was  no  difference  between  the  groups  In  flight  proficiency  In  the  air.  These  findings 
are  supported  by  more  recent  work  at  VP-30  (Browning,  Ryan  and  Scott,  1978). 

The  new  P-3C  simulator  costs  $4.2  million  (Figure  13).  Compared  to  the  control  pro¬ 
gram,  the  experimental  program  Is  estimated  to  save  $2.5  million  par  year  (assuming  a 
projected  load  of  200  pilots  per  year).  On  this  basis,  the  procurement  cost  of  the  new 
simulator  would  be  amortized  within  two  years, 

An  analysis  of  Investment  costs  also  favors  the  new  program  (Figure  14).  Based  on 
required  flight  hours,  th9  control  program  would  require  7  aircraft,  the  new  one  4.2 
aircraft  (at  $13.7  million  par  aircraft).  The  Investment  cost  of  the  new  program  Is 
$63.2  million  compared  to  $98,7  million  for  the  old  one.  The  10-year  life  cycle  cost  of 
the  new  program  is  $81  million  compared  to  $125  million  for  the  old  one. 

One  airline  provided  an  analysis  of  Its  costs  for  the  use  of  simulators  and  aircraft 
for  training  In  1976  (Figure  15).  Simulators  ere  used  for  training  purposes  for  26,000 
hours  each  year  and.  In  addition,  aircraft  for  over  1,100  hours.  The  cost  of  these  train¬ 
ing  hours  was  $6.8  million  In  1976.  This  airline  estimated  what  It  would  cost,  also  In 
1976,  If  all  these  training  hours  had  to  be  performed  only  In  aircraft.  That  total  would 
be  about  $32.1  million  a  year.  This  airline  estimates  that  Its  annual  training  costs 
for  simulators  and  aircraft  are  about  21  percent  of  what  they  would  be  If  they  hed  to 
depend  only  on  aircraft. 

The  flight  simulators  used  by  this  airline  cost  $17.5  million  (Figure  16)  and  the 
airline  estimates  that  their  use  saves  $25  million  per  year.  At  this  rate,  the  procure¬ 
ment  uf  flight  simulators  can  be  amortized  In  less  than  nine  months. 

These  four  studies  of  cost-effectiveness  support  the  use  of  flight  simulators 
(Flgnre  17).  Use  of  the  Navy  P-3C  simulator  and  the  Coast  Guard  VCTS  simulator  saved 
sufficient  flight  time  to  amortize  procurement  costs  within  two  years.  An  analysis  pro¬ 
vided  by  an  airline  suggests  an  even  shorter  amortization  period. 

6.  DISCUSSION 

Most  simulator/aircraft  operating  cost  ratios  fall  In  the  range  of  0.05  to  0.20. 

The  use  of  flight  simulators  appears  to  save  flight  time  In  aircraft.  The  range  of 
these  values,  expressed  as  Transfer  Effectiveness  Ratios,  varies  from  close  *o  zero  to 
well  over  one,  with  a  median  at  about  0.50,  Thus,  there  is  a  clear  Implication  that 
flight  simulators  can  be  cost-effective  for  training  providing  careful  attention  Is  given 
to  their  use  for  tasks  and  maneuvers  where  the  transfer  effectiveness  ratios  are  greater 
than  the  simul itor/alrcraf t  operating  cost  ratios.  There  Is  also  a  clear  Indication  that 
the  Incremental  transfer  effectiveness  ratio  decreases  as  training  time  Increases:  thus, 


It  Is  possible  to  determine  an  optimum  point  at  which  training  for  particular  tasks 
should  shift  from  the  simulator  to  the  aircraft,  only  a  few  studies  of  cost-effective¬ 
ness  have  actually  been  conducted.  Here,  It  appears  that  the  cost  of  procuring  flight 
simulators  can  be  amortized  within  about  two  years. 

Some  recent  developments  In  flight  simulators  can  significantly  affect  their  cost 
and  effectiveness.  A  six  degree  of  freedom  synergistic  motion  platform  can  cost  up  to 
$0.6  million.  A  series  of  studies  since  1974  have  shown  that  there  Is  no  difference  In 
performance  In  aircraft  botwaen  pilots  trained  In  simulators  with  motion  and  pilots 
trained  without  motion  (Koonce,  1974;  Jacobs  and  Roscoe,  1975;  Woodruff  and  Smith,  1974; 
Gray  and  Fuller,  1977,  Woodruff,  Smith  #t  al.,  1976;  Martin  and  Waag,  1978).  Although 
mora  work  remains  to  be  done,  It  appears  that  modern  flight  simulators  for  canter  thrust 
aircraft,  with  good  visual  systems,  do  not  need  platform  motion.  Recent  procurements  of 
F-16  and  A-lo  simulators  by  the  Air  Force  do  not  Include  platform  motion.  It  Is  still  an 
open  question  whether  platform  motion  Is  needed  In  simulators  for  wide  bodied  aircraft. 

Incidentally,  a  concern  with  Improving  the  fidelity  of  flight  simulators  led  to  the 
Improvement  of  platform  motion  over  the  past  15  years.  It  Is,  of  course,  true  that  pi¬ 
lots  perform  batter  In  simulators  with  motion  than  In  simulators  without  motion.  Until 
Koonce's  study  In  1974,  no  ora  seriously  questioned  whether  platform  motion  In  simulators 
contributes  anything  to  performance  In  aircraft.  The  answer  so  far  seams  to  be  “'not 
much".  These  recent  findings  also  suggest  that,  except  possibly  to  improve  pilot  accept¬ 
ance,  the  test  of  fidelity  of  simulation  may  not  always  give  us  a  good  answer. 

New  computer-generated  visual  systems  can  provide  types  of  training  In  simulators 
that  have  not  been  possible  up  to  now.  They  can  present  scones  needed,  for  example,  for 
training  In  aerial  refuelling,  air-to-air  combat,  and  nap-of-the-earth  flying.  Visual 
systems  for  flight  simulators  are  very  impressive  devices.  So  Is  their  cost,  which  Is 
now  In  the  range  of  $6  to  $8  million  per  copy.  The  real  question  concerns  the  degree  of 
realism  required  to  make  visual  displays  useful  for  such  types  of  training.  Very  little 
data  are  new  available  to  help  us  specify  the  visual  requirements  for  this  most  expensive 
component  of  a  modern  flight  simulator.  There  Is  one  study  In  which  Air  Force  pilots  were 
trained  In  simulators  to  land  a  8-707  using  one  of  three  different  visual  simulation  sys¬ 
tems  and  then  measured  for  their  ability  to  land  a  KC-135  aircraft,  the  tanker  version  of 
the  B- 707  (Thorpe, Varney  et  al.,1978).  The  visual  scenes  were  produced  by  a  day  computer- 
generated  Imagery  (CGI)  system,  a  day  TV  modal  board  system  and  a  night-only  computer- 
generated  Imagery  system.  Pilot  performance  on  landing  the  aircraft  was  superior  for 
those  trained  on  the  two  CGIs  than  for  those  trained  on  the  TV  modal  board;  there  was  no 
difference  between  the  two  CGI  systems  as  far  as  landing  performance  Is  concerned.  If  we 
accept  the  results  of  this  one  study,  the  less  expensive,  night-only  CGI  Is  all  we  need 
for  training  pilots  how  to  land.  In  all  fairness,  further  studies  on  other  maneuvers  and 
other  types  of  simulators  are  needed  before  we  can  specify  what  type  of  visual  Imagery  Is 
good  enough  for  various  types  of  training.  Hera  again,  Imagery  with  the  greatest  fidelity 
and  highest  cost  may  not  be  all  that  necessary, 

One  final  point.  It  Is  quite  likely  that  flight  simulators  will  be  found  to  be  cost- 
effective  and  as  a  result,  there  may  be  more  pressure  to  reduce  flying  hours.  Flight 
simulators,  however  useful,  are  not  a  substitute  for  training  In  aircraft.  Military 
training  must  proceed  from  simulators  to  aircraft  and  there  Is  some  minimum  amount  of 
flight  time  required  below  which  one  cannot  go.  This  Is  necessary  to  maintain  combat 
skills  and  to  exercise  support  systems,  such  as  maintenance  and  command  and  control,  on 
which  military  readiness  depends.  More  attention  must  clearly  be  given  to  establish  whac 
those  minimum  flying  hours  should  be. 

6.  CONCLUSIONS 


a.  Flight  simulators  cost  less  to  operate  than  do  aircraft;  most  simulator/aircraft 
operating  cost  ratios  fall  within  the  range  of  0.05  to  0.20. 

b.  Flight  simulators  save  flight  time.  Transfer  Effectiveness  Ratios  vary  widely, 
with  a  median  value  of  about  0.50.  This  means  that  about  half  the  time  spent  In  simula¬ 
tors  shows  up  as  savings  In  flight  time. 

c.  The  cost  of  procuring  flight  simulators  can  be  amortized  In  about  two  years. 

d.  Research  and  development  is  needed  to  Improve  our  knowledge  about  the  optimum 
use  of  simulators  for  various  types  of  flylnq  tasks.  There  Is  a  need  to  establish  the 
optimum  point.  In  terms  of  effectiveness  and  of  cost, at  which  training  should  shift  from 
the  simulator  to  the  aircraft.  There  is  also  a  need  to  examine  the  need  for  platform 
motion  In  simulators  for  wide  bodied  aircraft  and  for  the  degree  of  realism  needed  In  new 
visual  displays. 

e.  There  Is  a  need  to  establish  the  minimum  amounts  of  flying  hours  needed  to  main¬ 
tain  combat  skills  and  to  exercise  support  systems. 


REFERENCES 

1.  Browning ,  R.F.,  L.E .  Ryan,  P.G.  Scott,  April  1978,  "Utilization  of  Device  2F87F  OFT 
to  Achieve  Flight  Hour  Reductions  In  P-3  F’eet  Replacement  Training",  TAEG  Report 
No.  54,  Training  Analysis  and  Evaluation  Group,  Orlando,  Florida. 

2.  Browning,  R.F, ,  L.E,  Ryan,  P.G.  Scott  ana  A.F.  Smode,  January  1977,  "Training  Effec- 
Mveneis  Evaluation  of  Device  2F87F,  P-3C  Operational  Flight  Trainer",  TAEG  Report 
No.  42,  Training  Analysis  and  Evaluation  Group,  Orlando,  Florida. 

3.  Gray,  T.H.  and  R.R.  Fuller,  July  1977,  "Effects  of  Simulator  Training  and  Platform 
Motion  on  A1  r-to-Surface  Weapons  Delivery  Training",  AFHRI.-TR-77-29,  Williams  Air 
Force  Base,  Arizona,  Flying  Training  Division,  Air  Force  Human  Resources  Laboratory. 

*•  Holman,  G.L.,  May  1979,  "Training  Effectiveness  of  the  CH-47  Flight  Simulator",  Re¬ 
search  Report  1209,  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social 
Sciences,  Alexandria,  Virginia. 

5.  ;Isley,  R.H.-,  W.E,  Corley  and  P.W.  Caro,  October  1  974,  "The  Development  of  U.S.  Coast 
Guard  Aviation  Synthetic  Equipment  and  Training  Programs",  FR-D6-74-4,  Human  Re¬ 
sources  Research  Organization,  Fort  Rucker,  Alabama, 

5.  Jacobs,  R.S.  and  S.N.  Roscoe,  10-20  November  1975,  "Simulator  Cockpit  Motion  and  the 
Transfer  of  Initial  Flight  Training"  In  New  Concepts  for  Tralnln 


,  navai  iraimng  tquipment  center,  uriani 


inTimitii 


7.  Koonce,  Jefferson  M.  ,  1979,  "Predictive  Validity  of  Flight  Simulators  as  a  Function 
of  Simulator  Motion",  Human  Factors.  2J_,  21  5-223. 

8.  Martin,  E.L.  and  W.L.  Waag,  June  1978,  "Contributions  of  Platform  Motion  to  Simulator 
Training  Effectiveness!  Study  I--Bas1c  Contact",  AFHRL-TR-78-1 5;  September  1970, 
'Study  I I--Aerobat1cs" ,  AFHRL-TR-78-52,  Williams  Air  Force  Base,  Arizona,  Flying 
Training  Division,  Air  Fcrce  Human  Resources  Laboratory, 

9.  McFarland,  Marvin  W.,  editor,  1972,  The  Papers  of  Wilbur  and  Orville  Wright,  (two 
volumes),  Arno  Press,  New  York,  Reprint  Edition. 

10.  Orlansky ,  Jesse  and  Joseph  String,  August  1977,  "Cost-Effectiveness  of  Flight  Simu¬ 
lators  for  Military  Training",  IDA  Paper  P-1275,  Institute  for  Defense  Analyses, 
Arlington,  Virginia,  (2  volumes),  ODC  No's.  AD  A052-801  and  AD  A049-979. 

11.  Povenmlre,  H.K.  and  S.N. Roscoe,  1973,  "Incremental  Transfer  Effectiveness  of  a  Ground 
Based  Aviation  Trainer",  Human  Factors.  15.,  534-542. 

12.  Roscoe,  S.N. ,  1971,  "Incremental  Transfer  Effectiveness,  Human  Factors,  14. 

363-364.  -  — 

13.  Thorpe,  J.A.,  N.E.  Varney,  R.W.  McFadden,  W.D.  LeMaster  and  I..H.  Short,  June  1978, 
"Training  Effectiveness  of  Three  Types  of  Visual  Systems  for  KC-135  Flight  Simulators 
AFHRL-TR-78-16,  Williams  Air  Force  Base,  Arizona,  Flying  Training  Division,  Air  Force 
Human  Resources  Laboratory. 

14.  Woodruff,  R.R.  and  J.F.  Smith,  November  1974,  "T-4G  Simulator  and  T-4  Ground  Training 
Device  in  USAF  Undergraduate  Pilot  Training",  AFHRL-TR-74-7B,  Williams  Air  Force  Base 
Arizona,  Flying  Training  Division,  Air  Force  Human  Resources  Laboratory. 

15.  Woodruff,  R.R.,  J.F.  Smith,  J.R.  Fuller  and  D.C.  Weyer,  December  1976,  "Full  Mission 
Simulation  In  Undergraduate  Pilot  Training!  An  Exploratory  Study",  AFHRL-TR-76-84, 
Williams  Air  Forca  Base,  Arizona,  Flying  Training  Division,  Air  Force  Human  Resources 
Laboratory. 


Figure  1:  THE  SANDEi.S  TEACHER,  ENGLAND.  1910 


SIMULATOR,  OPERATING  COST  PER  HOUR  (dollor*) 


Figure  2  : 


VARIABLE  OPERATING  COSTS  PER  HOUR  FOR  33  SIMULATORS 
AND  AIRCRAFT,  FT  1975  AND  FT  1976 
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TRANSFER  EFFECTIVENESS  RATIOS  AND  PILOT  EXPERIENCE 
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Source  Holman,  1979. 


Figure  6!  TRANSFER  EFFECTIVENESS  RATIOS  FOR  E4  MANEUVERS,  CH-47 
FLIGHT  SIMULATOR  (TRIALS  TO  CRITERION)  (Source! 
Holman,  1979) 


Figure  7: 


HOURS  NEEDED  FOR  FINAL  FLIGHT  CHECK,  RIPER  CHEROKEE 
(Source:  Povenmlr*  end  Roscoe,  1973) 
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Figure  8:  INCREMENTAL  TRANSFER  EFFECTIVENESS  RATIO  (ITER)  AND 

OPERATING  COST  RATIO  (Source:  Povenmire  end  Roscoe 
1973  ) 
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Figure  9:  HELICOPTER  TRAINING,  U.S.  COAST  GUARD 
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Figure  10:  ESTIMATED  TRAINING  COSTS  IN  THE  COAST  GUARD  BEFORE 

AND  AFTER  INTRODUCTION  OF  THE  VCTS  SIMULATOR,  1974 
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Figure  11:  AMORTIZATION  OF  VCTS,  U.S.  COAST  GUARD 
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Figure  1Z: 


PILOT  TRAINING  ON  P-3C,  ANTI-SUBMARINE  WARFARE 
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Figure  1 3 ;  AMORTIZATION  OF  P-3C  SIMULATOR 
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Figure  14:  P-3C  INVESTMENT  COSTS 
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Figure  15:  ANALYSIS  OF  TRAININS  COSTS  BY  ONE  AIRLINE,  1976 
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SUMMARY 


Until  recently,  flight  training  simulator  computer!  have  generally  been  programmed  in  aiaembler 
languages  which  have  proven  their  efficiency.  The  computes  currently  available  for  flight  simulators 
are  capable  of  being  programmed  in  higher  level  languages  such  as  FORTRAN  which  arm  expected  to 
provide  analysts  with  a  more  accessible  data  processing  tool. 

During  current  contracts  for  commercial  aircraft  flight  aimulacori,  LMT  is  writing  simulation 
programs  for  tha  same  aircraft  in  both  assamhlar  and  in  FORTRAN.  This  experience  hat  provided  n 
valuable  insight  into  the  advantages  end  disadvantages  of  both  methods. 

I  This  paper  reviews  the  impact  of  each  method  on  the  analytical  and  programming  methods  employed  st 

j  each  stage  of  program  writing,  debugging  and  modification.  The  conaequoncea  of  computing  power  and 

(  memory  capacity  are  also  discussed. 


t 

1. 

I 

/K  .  V» 


INTRODUCTION 

Lb  choix  d'un  langage  dr  programmation  dans  les  syttAmes  scientifiques  temps  rtiel  a  toujoura  Ate  un 
aujet  trds  controvert^.  De  nombreux  langages  Avolues  ont  Ate  dcveloppCs,  et  utilisAs,  maia  aucun 
n'a  fait  1'unanimitA. 

Lea  simulnteure  d'eutralr.ement  au  pilotage,  pour  des  raisona  AconomlquiiS,  doivent  utilieer  dee 
calculateura  de  la  gamme  ditc  "Mini  au  industrielle". 

L'unite  de  truitemant  d'un  aimulateur  doit  uxAeuter  cycliquement  un  grand  nombre  d'Aquafcions 
mathAmatiques  at  logiquea  dans  un  temps  imposA  par  lu  frequence  dea  phenomtnas  A  aimuler,  et 
inffirieur  au  retard  perceptible  par  un  pilote. 

C'aat  pourquoi  la  puissance  de  calcul  du  systeme  OBt  uoujours  un  AlAmept  prtdominunh  A  considArer 
lora  de  la  conception. 

Le  languge  de  programmation,  par  contra,  peut  etre  diffArent  auivant  los  appliuations  6u  les  Clicnta. 

L'ArmAe  Amcricuina  dans  un  hut  de  standardisation  a  imposA  1 1 u t i 1 {nation  du  POhTRAN  pour  les 
simulateurs  d’entralnement.  Les  oimulateurs  de  vol  rAalisea  pour  1 '  enn'afnement  des  Aquipages  do 
Compagnics  Aeriennes  utilisent  depuis  plus  de  qui.ue  ana  deo  calculate'!!  s  numAriquea  universele 
programmes  en  languge  assembleur. 

Cea  euluulateurs  ont  toujours  cependant  possedA  un  n  mpilr.tour  FORTRAN,  langage  largentent  rApandu 
dans  le  domains  scientlf ique,  o'  particular  dana  la  si.nulniio:'  d'Atude. 

Aujourd'hui  ce  langage  fait  une  offensive  sArieuae  sur  le  roarchA  dec  slmulatturs  d'avions 
commorcluux,  bien  qu'll  n'ait  pas  encore  rAussi  A  couvointrj  tout  les  utilisateurs. 

Les  Compagnics  Aeriennes  rAur.lcs  A  Montreal  le  let  Juin  197b  (IACA  Flight  Simulator  Technical 
Sub-committee)  ont  pose  pour  la  premiire  fots  Is  question. 

Le  comitA  so  mit  d' accord  pour  consldArer  que  I’utilisation  d'un  langage  Avolue  pourrait  devenir 
un  standard  dans  le  futur,  mats  qu'A  ce  stade  d' expArlence  11  u'Ctait  paB  prUt  A  ruco.irm.'1,'''.: 
l'utilisatiorv  du  FORTRAN. 

Jusqn'A  cob  dernihres  amides,  Les  programmes  Acrits  en  FORTRAN  sur  les  mini-calculnteurs  Atuient 
pou  performance  compte  tonu  dea  calculs  en  virgules  flotta.Ues,  du  foim«.  dec  mots  do  16  bits,  das 
difficultAs  d'edrossage  et  d'un  repertoire  d' instruction  limits. 

Seul  le  Bavoir  faite  du  programmeuv  at  les  cuicul.1  en  virgule  fixe  purmetfeient  des  temps 
d'exAcution  des  programmns  compatibles  avec  la  frequence  de  rApAtition  de.i  calculs. 

Mala  la  complex! tA  croissante  des  syst&mes  A  simuler  et:  les  ameliorations  dettiandAee  par  lea 
utlLUateurs  ont  accru  la  puissance  domandile  pins  vlte  quo  la  rupidllA  des  memoires. 

L'arrivee  sur  le  marchA  de  uouveaux  eulculateuru,  clessAs  duns  In  gamme  "Mini"  par  leur  prix,  n.ats 
aynnt  des  performances  comparables  A  colics  des  onlculateurs  reserves  prAcAdemment  S  des  centres 
do  calcul  important*,  (format  do  mols  de  32  bits  et  operations  en  virgule  flottnate  ayant  des  t  inps 
d'exAcution  du  m8me  ordre  de  grandeur  que  nolle  en  virgule  fixel,  r  fait  ressurgir  1c  FORTRAN, 
atdA  par  une  large  publicitS  faite  par  les  conetrucleurs  annonqant  des  coefficients  de  folsonnement 
(expaiiBicn  due  au  languge)  suf f Isamment  fatblea  pour  8tre  convaincants . 
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Dane  1««  discussions  antra  Ui  fervent*  de  langagee  dvoluds  d'une  part  *t  du  langage  Aasembleur 
d'autra  parti  s'oppoaent  gdnfiroleraant  dee  partisans  farouche*  de  l'una  ou  l'autra  technique, 
adparda  par  una  incomprd hane ion  mutuelle.  En  effet,  let  partisan*  du  langage  dvolud  ont  eouvent, 
utilisd  uniquement  dea  langagee  dvoluds,  et  leg  partisans  du  langage  assembleur  ont  une  pratique 
constants  de  ce  type  de  langage. 

Une  cnmparaiaon  objective  de*  (ventages  et  inconvinleut*  rdeiproqu#*  d'un  langage  estenblaur  et 
d'un  1 engage  dvolud  pour  un  syithte  donnl  att  done  difficile,  cer  rates  sont  let  rdelisetions 
comparables  affactudas  avec  cat  deux  langages,  sur  un  celculateur  iJentiquc,  I  une  mime  dpoque 
et  par  det  dqulps*  de  niveau  ou  da  formation  tlmilaire. 

Notre  Division  a  rdaliad  rfeemment  deux  simulateure  de  l'avion  Airbus  A300,  programmes,  l'un  en 
langage  Aaaaablaur  at  l'autra  en  FORTRAN. 

Le  celculateur  utilisd  eat  la  SEL  32/55. 

Les  conditions  ont  done  it(  ramplies  pour  rdalisar  une  (valuation  comparative  das  deux  ndrhodte. 

Ce  papier  rend  compte  d'un  premier  bilen  de  catte  axplrience. 

Cette  dtud*  a  dtd  antreprise  avec  l'side  du  Minister*  de  1’ Industrie. 

2.  CONFIGURATION  DU  SYSIKMt,  ETUDIE 

Les  avantages  et  inconvdniants  d'un  langage  de  programmation  dtant  spdcifiquea  A  1 'application, 
nous  ddcrivans  las  caractiristiques  principal**  du  aystdme  pour  laqual  not  conclusions  aont 
applicable*.  Le -ays time  concern^  eat  un  aimulataur  d'entratnement  au  pilotage  da  l'avion  AIRBUS 
A300. 

2. 1  Entrdea-sortlea 

Du  point  da  vue  entrdea-aortia*  induatrielles,  la  syetAme  doit  pouvoir  traiter  par  aeconda  environ 
100.000  entrdaa-sortiea  binaires  et  5000  antrde-sorties  analogiquna. 

Le  systAme  g6re  dgalcment  en  tempa  rdel  une  base  de  denude*  sur  disqua  et  deux  tubas  cathodiquci 
utilises  par  las  inatructeurs  pour  intervenir  sur  la  aystAme. 

Da  plus  1(300  mots  aout  dchangds  par  aeccnde  mi  un  proceaeaur  traitant  daa  problAmae  da  simulation 
da  coiuoandes  da  vol. 

Cea  chiffrea  montrent  qua , contrairement  aux  aimulataur*  d'dtudes,  les  programmaa  da  traitemant 
logiqua  prennent  une  place  important*  dans  le  syatAma. 

2.2  Capacltd  mdmolra 

Lea  programme*  do  simulation  de  systAmea  avion*  dcrits  en  Asasmbleur  raprdsentent  62  Kmots  de 
32  bit*.  Ce  total  eat  de  90  Kmots  pour  l'ensemble  Equivalent  en  FORTRAN. 

A  chaquc  systAmc  avion  correspond  un  programme  dont  1' importance  peut  verier  da  0,5  Kmot*  A 
8  Kmots  (en  assomblaur).  Cas  programmaa  curamuniquont  par  un  bloc  de  valaura  commune*  (DATA  POOL) 
de  4  Kmots. 

Chnque  programme  est  lui-meme  diviad  an  module*  communiquant  par  des  valeurs  communes  qui  lui  sont 
proprea  (COMMON) . 

La  capacltd  mdmoire  de  1' ensemble  du  aimulatrur,  incluant  le  loglciel  de  base  du  conatructeur  (RTM), 
le  moniteur  tempa  rdel  spdclfique  A  1' application,  lea  programmes  du  poate  da  1 ' instructeur,  ainsi 
que  la  mdmoire  suppldmentaire  prdvue  pour  lea  dventuelles  modifications  et  l'exdcution  rle  tlc.he* 
diffdrdea  exdcutdus  pendant  les  temps  libres,  peut  varier  de  126  A  240  Kmots  auivant  las  options 
et  le  langage  retenus, 

2 . 3  Cycle  de  calcul 

Las  etches  les  plus  urgonte*  doivant  St.re  exdcutdes  touts*  les  50  ms,  cycle  de  calcul  de  base,  at 
tous  lac  programmes  da  simulation  doivent  avoir  did  exdcutds  au  moins  2  foi*  par  seconds. 

3 .  PARAHETRKS  IN FLU BN CANT  LE  CHOTX  DU  FORTRAN 

3. I  Format  des  donnde* 

J .  1 . 1  Calcula  scientif iquea 

Les  valems  utilisdes  sont  des  nombres  rdels  ayant  une  partie  entiAre  et  une  partie  fractionnaire. 

Le  FORTRAN  tralte  cea  nombres  obllghtoirament  en  virgule  flottante.  Ausai  un  argument  aouvent 
ddveloppd  en  favour  du  FORTRAN,  est  1 1  ,imt liorution  de  la  prdciaion  des  caleuls  gr3ce  A  la  virgule 
flottante. 


Ce  raiaannement  vient  du  felt  que  dans  les  simalatours  progremmds  en  langage  assembleur,  les 
calcula  aont  effected*  en  virgule  fixe  nfin  d'optimiasr  le  ten<pa  d'exdcution  des  programmes,  des 
instructions  en  virgule  flottante  performante*  n'oxistant  pas. 
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Laa  calculi  an  vlrgula  fix*  rnprfisentant  una  vfiritabla  difficult*  pour  la  programmeur,  lac 
recadragea  (tant  la  source  da  nombreuses  erreurs.  La  format  da  16  bits  aouvant  utilio*  dana  laa 
mini-calculateura  da  la  gdnfration  pr£c*dente,  rendait  critiques  lea  problimea  da  prfciaion  at 
obligeait  aouvant  1  fairs  das  culouls  an  double  precision. 

Avec  lea  calculateura  actuals,  ayant  un  format  da  donndea  our  32  bits  et  das  instructions  en 
virgula  flottante  rapidaa,  la  prograatnation  daa  calculi  an  format  flottant  avec  la  langage 
asaembleur  na  posa  aucuna  difficult*. 

La  qualit*  da  la  simulation  n'aat  done  paa  amSliores  par  la  FORTRAN,  at  en  fait  la  langaga 
asaemblsur  laiaaa  un  plua  grand  choix  dana  la  format  das  donnSes. 

En  affat  la  virgula  flottante  n'a  paa  qua  daa  avancages  dana  un  aimulataur,  car  laa  sntrtas-aortiss 
aont  naturallament  an  virgula  fixe,  corraapondant  a  daa  tensions  (lactriquaa.  II  aa  poaa  ainsi  un 
problfims  da  conversion  Flottant/Fixa,  Fixe/Flottant,  coQtaux  an  tempi  da  calcul,  Una  maniira  da 
rfisoudrs  ce  probiama  ait  da  fairs  axicutar  caa  conversions  par  1' interface. 

Notona  dgalemant  qua,  si' las  instructions  ciblSaa  an  FORTRAN  sont  ralativament  parformantas, 
alias  sent  cepsndant  nattamsnt  plus  lentas  qua  Isa  operations  en  virgule  fixe. 

1.2  Calcul  loglque 

Compte  tenu  du  grand  nombre  d' sntrdes-aortias  logiques,  correspondent  A  das  intarrupteurs  at 
voyants  dans  la  cabino  da  1' avion,  cheque  entrta  ou  sortie  eat  reprlssntSe  par  un  bit,  l'ansambls 
daa  bita  dtant  regroupSs  dans  un  mot  afin  d'utiliser  au  mioux  lea  canaux  d'entrdas-aorties  rapidaa. 

Le  langage  assembleur  est  bien  adapt*  au  calcul  logique  sur  bits  et  la  programmeur  sxpiriment* 
•ii.pourra  optimises  certaines  sfiquences  de  programme  avec  une  disposition  adequate  des  bits  dans  lea 
mots,  ou  par  l'adresaage  indirect,  II  pourra  Sgalament  tester  das  groupea  da  bita  par  une  eeule 
opfration. 

Le  FORTRAN  n'offre  g*n*ralament  paa  la  mama  aouplaaaa  de  traitnraent  du  bit,  en  particulier  dana  le 
caa  de  tableaux  de  bits  indices,  frdquenta  dans  le  problfcme  de  simulation  de  logique  pour  des 
syst£mes  daub  Ids,  triples  ou  quadruples, 

En  outre,  lea  functions  sur  bit  ne  sont  pas  standsrds  an  FORTRAN  et  n'exietent  paa  sur  tous 
Lea  compilatours.  L'identit*  des  ddclarations  n'eat  done  pas  assurfie  quand  la  posaibilit* 
exls  tu. 

Nous  revorrona  ce  problbme  dans  l'*tude  de  In  facilit*  d'lcriture  at  du  coefficient  da  foiaonnemant. 
2  Facilit*  d'Scrlture 


It  eat  habitual  d'entandra  ou  du  lire  quo  l'avantage  majeur  d'un  langage  Svolu*  aur  lo  langage 
aasembleur  ast  la  facilit*  d'Sarlturcs  des  programmes.  Cast  an  fait  aa  raison  d'Strs, 

Le  langaga  Assembleur  eat  spdclfique  d'un  calculateur,  demands  una  connaisaance  du  fonctlonnement 
de  ce  dernier,  et  lea  erreurs  de  coduge  aont  nombreusca  et  paa  facilament  dfitectablas  en  dehorn 
das  erreurs  de  syntaxe.  De  plus,  le  programmeur  doit  avoir  en  tete  les  contraintea  d'adressage 
et  J. 'indexation, 

he  programmeur  passe  diff icilement  d'un  langage  aasembleur  A  un  autre  malgr*  une  apparante 
facilit*.  11  vout  g*nfcralement  appiiquer  au  nouveau  calculateur  dos  sfiquencos  particuliSrement 
udapteeB  au  pr*c*dent,  et  si  le  jeu  d ' instructions  est  trea  different,  le  rSsultat  sera  mauvala. 

II  faudre  done  une  readaptation  plus  ou  meins  longue,  et  oublier  un  langage  pour  en  utiliser 
un  autre  eff icacenient.  Aussi  l' utilisation  simultance  de  plusieurs  calculateurs  par  un  m3me 
programmeur  *  une  influence  ndfaste  sur  la  qualit*  des  programmes. 

Knfin  beaucoup  de  langages  Assembleur  ne  pousisdent  pas  de  directive  pennettant  1'dcriturc  elite 
de  nombre  f ructionnaire  en  virgule  fixe. 

l’ar  centre  l'utillsation  de  macro  Instructions  sn  assembleur  permet  d'amdliorer  largement  la. 
facilit*  d'Ccrituro,  sans  pfinaliser  la  puissance  du  systeme, 

Le  FORTRAN  eat  un  langage  univnrsel,  thfioriquement  standard  et  indlpendnnt  du  calculateur 
utilis*. 

Rarea  sont  lea  calculateurs  ne  possSdant  pas  de  con.pilateur  FORTRAN,  et  presque  tous  les  *tudiants 
en  sciences  et  techniques  apprennent  les  bases  de  ce  langage  3  l'tcole. 

Lependant  ce  oritiire  de  choix  en  faveur  du  FORTRAN  doit  etre  modlsrf  par  le  fait  que  pour  amCliorar 
let  possibllitts  des  compilnteurs  FORTRAN,  les  constructeurs  ddveloppent  des  options  non  standards, 
et  qu'un  programme  utilisant  toutes  les  options,en  particulier  d'un  F0RTP.AN  dit  "temps  r*el",  d'un 
calculateur  no  sera  pas  transportable  sur  un  autre  culoulateur . 

En  outre  si  le  crltftre  d'offlcacit*  du  cuiup  lint  cur  entre  en  jeu,  et  si  le  coefficient  de 
foLsonnemeut  ust  critique,  alors  I'dcriture  d'un  programme  en  FORTRAN  devru  suivre  des  rbgles 
strictes,  diffdrentes  pour  cheque  calculateur,  si  on  veut  que  le  code  g*n*r*  suit  acceptable, 


23-4 


On  tliminera  souvent  htlas  les  sequences  lai  plus  agrtables  4  Scrire  par  la  pulaaanca  d«* 
leurs  possibilitts. 

Le  nrogranmeur,  pour  dtcouvrir  ces  rtgles  d'uti lisation,  que  le  construt-teut  Be  garde  blen  de 
comauniquer,  davra  alora  Studies:  le  code  gtntre  par  le  compilateur,  et  done  connattre  le 
langaga  Aaaembleur.  Ainai  dana  un  aysttme  oG  la  marge  da  puissance  eat  critique,  la  prngraaoeui 
pourra  fitre  ament  1  rttcrire  pluaiaura  foie  un  programs*  FORTRAN  afin  d'optimiaar  la  coda  gtntrt. 

Ca  n' eat  qu'apris  pluaiaura  expfriancaa  qu'il  pourra  tcrlra  an  FORTRAN  "rtdult"  un  programa* 
optimist. 

Le  crittre  "tempa  rtal",  lit  S  daa  facteure  d'tccnomie,  diminue  done  la  facilitt  d'dcriture 
FORTRAN,  ce  probltme  existent  pour  toua  laa  langagaa  (volute. 

3.3  Goafflclant  da  folaonnawent 

Un  programaa  (crit  an  FORTRAN  prend  un  nsmbre  da  mote  mtmoire  at  un  tamps  d'axteution  plua 
important*  qu'un  programme  (crit  an  Aaaamblaur.  Si  catta  affirmation  eat  qualitativement 
incontestable ,  la  quantification  d'un  rapport  d'afficacitt  ait  trta  difficila. 

Noua  appalona  coafficiant  de  foiaonnement  la  rapport  antre  un  chiffra  (nombre  da  aota  ou  tempi 
d'ax(cution)  obtenu  an  FORTRAN  et  le  correapondant  an  Aaaamblaur, 

Ca  critlra  eat  Important  pour  un  aimulataur  da  vol  dont  l'environnamant  tampa  r(el  conduit  A  un 
factaur  tempi  d'axteution  daa  programme i  critique.  L'axpanaion  de  la  capacit(  m(moira  paut  stabler 
moins  critique  compta  tanu  du  prix  daa  mtmoirca  actual.  Cepandant,  1' augmentation  du  volume  mtmoire 
diminue  la  fiabilitt  du  aysttme  at  paut  amener  k  una  organisation  plus  complaxa  compta  tsnu  les 
probltmas  d'adrcssaga.  D«  touts  fajon,  il  existe  una  rslstion  directs  antra  la  ttombr*  da  mote 
mtmoire  at  le  temps  da  calcul. 

Lora  da  la  conception  d'un  nouveau  ayatlm*  en  FORTRAN,  t  partir  d'un  ayittme  ronnu  an  Aasamblaur, 
le  progremmaur  doit  8tre  capable  d'tvaluer  la  coefficient  de  foieonnement.  II  utilise  pour  cats 
la  technique  du  "benchmark". 

On  dtiigne  sous  ca  terme  un  programs  d'essai  psrmattant  da  faira  una  (valuation  d'un  systkma 
informs tique, 

11  ast  bisn  difficila  d'obtsnir  daa  chiffraa  «i(jnif icatifa  du  constructaur  de  calculataur, 
concernant  l'afficacitt  du  compilataur  FORTRAN.  En  affat  laa  rtsultata  d'un  "Benchmark"  na 
sent  valablta  qua  pour  dal  programme!  similairea,  et  l'tcritura  d'un  programs#  FORTRAN  doit  tanir 
compta  du  calculataur  pour  obtanir  un  coda  gtntrt  optimlit.  Ausai  un  programme  FORTRAN  (crit  par 
un  constructaur  pour  aon  calculataur  pourra  dunntr  daa  rtaultata  remarquablas  dana  un  caa 
particullar,  et  dea  rtaultata  trta  mauvaia  sur  lc  calculataur  du  concurrent. 

Ftut  Sere  l'invarae  pourra-t-il  at  produire  pour  un  autre  programme,  ou  slmplament  an  tcrivant  la 
ra8me  programme  avac  una  technique  difftranta. 

Auasi  le  "benchmark"  universal  n'exista  paa,  at  la  progremmaur  voulant  (valuer  un  ayatime  dolt 
tcrire  lui-mima  ion  progranna,  ca  dernier  devant  Stra  le  plua  raprtaantatif  du  sytttma  dtfinitif. 

Pour  etre  aignif icatifa,  laa  "banchmirks"  doivant  utilisar  un  grand  nombre  d' inatructiona,  tcritea 
aans  intention  prtalable  de  dtmontrer  l'efficacitt  ou  1' inefficacitt  d'un  compilataur  donnt. 

Un  example  claesique  d'un  mauvaia  "benchmark"  FORTRAN  ast  le  auivant  : 

DO  100  I  -  1  ,N 

Z  (I)  -  X  (I)  a*  2  -  (A+B)  »  Y 

100  CONTINUE 

Le  progranaaur  aurait  dQ  aortir  le  calcul  da  (A+B)  »  Y  qui  n'aat  paa  indict  afin  d'amtliorer  le 
tempa  de  calcul. 

Or  certains  compilateurs  corrigent  cette  erreur  et  d'autres  paa.  La  comperaleon  das  temps 
d'axteution  du  "Benchmark"  dans  ce  caa  sera  done  fausate. 

L'utiliaation  de  "Benchmark"  pour  comparer  un  langaga  (volut  A  un  langaga  asacmbleur  a  fin  d'un 
dtduire  un  coefficient  da  foiionnement  eat  encore  plua  subtile. 

De  meme  qu'un  programmaur  connaisaant  bian  let  particularity  d'un  compilataur  paut  optimiaer  le 
code  gtntrt  sur  un  talculateur  pertiruliur,  un  programmeur  sxptrimantf  en  ssaambleuc  pourra 
optimiaer  plua  ou  moins  une  atquence  de  programmatlon  au  detriment  de  la  facilitt  d'tcriture,  de 
miae  au  point  et  de  modification. 

Auasi  les  chiffres  donnte  pour  dea  programmes  de  dtmonstration,  ou  de  courts  sous-programmaa 
doivent  ttre  considtrta  avac  prudence. 

3 . 4  Mlee  au  point  del  programme!  et  modifications 

Uu  programs  de  simulation  comporte  deux  niveaux  de  mise  eu  point.  Le  premier  consists  il  tlininer 
les  erreure  de  codage  et  le  deuxUme  il  mettre  au  point  la  madf lisation  A  l'aide  das  rtsultats 
fouvnis  par  le  programme. 
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La  pramiire  phase  esc  importanta  pour  un  progranme  Bcrit  en  aesemblaur.  Das  erreurs  de  codage  non 
iliminiea  pendant  la  premiira  phase  perturbent  souvent  la  deuxiime  phase. 

Lee  compilateurs  iliminant  la  plupart  deB  orreurs  de  syntaxe,  la  programmer  ion  FORTRAN  permet  une 
mise  au  point  tria  rapide  du  premier  niveau. 

La  technique  utilises  pour  la  mise  au  point  da  la  mobilisation  act  la  mSme  an  asiembleur  ot  an 
FORTRAN. 

Cependant  les  temps  da  modifications  et  d'essais  sont  plus  longs  an  FORTRAN  dans  la  mcsure  oG  le 
programme  doit  Stra  recompile  1  chaque  modification  alors  que  le  langege  aaaembleur  permet 
1' introduction  de  liquances  proviaoirai  sans  assemblage.  Cette  possibility  ast  particuliSrement 
appriciie  pendant  las  testa  en  toraps  riel  avec  la  cabine  de  l'avion. 

Cependant  la  probabiliti  d'orreur  par  modification  du  code  machine  tana  assemblage  eat  asset  grande 
et  la  mise  8  jour  du  programme  source  est  quelquefois  oubliie  ou  diffirente  de  la  modification 
provisoira, 

La  mise  au  point  da  la  modiliuation  en  FORTRAN  sera  done  peut-Stre  plus  longue  maia  sera  plus  sdre. 
3.5  Documentation 


Dana  un  programme  en  langage  Aaaembleur  lea  commentairea  se  trouvent  aur  la  mime  ligne  que 
1* instruction. 

Uue  instruction  ccmportant  peu  d'informatiems,  la  place  eat  auffisante  pour  lea  comments irsa. 
Cependant  pour  aasimiler  la  structure  d'ensemble  du  programme,  das  organigrames  ditaillis  sont 
■'indisper  sables. 

Las  ordraa  FORTRAN  sont  suf f iaamment  explicitei  pour  qu'ils  constituent  eux-mimus  une  documentation, 
Cependant  la  difficult  de  comprihanaion  n'est  pat  tant  dans  les  ordres  que  dans  la  signification 
das  symboles  das  paramitres.  De  nombreux  symboles  pouvant  apparattre  aur  une  mSme  ligne,  et  lea 
commentairea  itant  sur  des  lignes  riaerviei  3  cet  uaage,  un  programme  FORTRAN  bian  commenti 
comportera  plus  de  lignea  de  commentairea  que  de  lignes  d'ordres. 

Le  programmeur  devra  faire  un  effort  de  mise  en  page  pour  que  lee  ordres  FORTRAN  ne  Solent  pas 
"noyis"  dans  lea  commentairea, 

Les  organigrammes  accompagnant  un  programme  FORTRAN  peuvent  3tre  plus  giniraux  que  pour  un 
programme  Assembleur, 

A.  UTILISATION  DU  FORTRAN  POUR  UN  SIMULATEUK  D' AIRBUS 


4 . 1  Introduction 

Le  slmuljteur  AIRBUS  n'est  pas  notre  premiire  experience  du  FORTRAN  mais  e'est  Is  plue  complete 
canccrnant  nn  particular  les  problimes  de  logique. 

Nous  avons  utilise  ce  langage  principalement  pour  effectuer  des  etudes  de  simulation  en  centre  de 
calcul,  et  pour  rialiser  des  programmes  utilitaires  ou  de  maintenance.  Far  nilleurs,  des 
aimulateurs  de  centrales  nucliairei  sont  rialisis  pnrtlellement  en  FORTRAN. 

Le  chapitre  prlcfident  U  ant  compt.e  de  l'ensemble  de  notre  cxpirience  et  des  recherchos  effectuies 
sur  le  sujot.  Dans  ce  chapitre  nous  examinons  les  critires  vus  pricedemment  pour  le  cas  du 
aimulatcur  d'Airbus. 

4 . 2  Format  des  dnnndcs 

Tous  leB  calculi  matheraatiques  sont  offectuis  en  format  flottant  sur  32  bits  (REAL),  sauf  certains 
ealcula  de  navigation  oG  la  double  priciBlon  s'est  nvlrie  nioessaire.  Kappelons  que  aur  le  SEL  32 
le  format  REAL  est  de  la  forme  I 

X  ■  F  *  I6E-64  oG  1/16  <  F  <  I  -  16"®  el  -  64  <  (E  -  64)  <  63  F  itant  sur  24  bits  et  E  sur  B  bits. 
Pour  des  calcuts  et  tests  loglques,  les  formats  bits  et  octets  sont  utilisis. 

4.3  Facility  d' icrltute 

Le  programmeur  FORTRAN  disposals  d’un  document  d'analyse,  du  programme  assembleur  et  de  l'nssistance 
du  progtattmeur  ayaut  ficrit  le  programme  assembleur. 

Des  rOgles  de  base  liiea  aux  probifemes  de  communicat ion  entro  programmes  out  6ti  donniua  s 

-  ”aleurs  communes  inter  programmes  dnnB  un  "COMMON  DATA  POOL". 

-  valeurs  communes  inter  modules  d'un  programme  dsns  un  "COMMON"  unique  compili  even  chaque  module. 

-  donndes  communes  loglques  sur  octets. 

Aucune  rOglu  restrictive  n'a  iti  Jmposie  au  programmeur  sous  forme  d '  interdict  ion,  cons  i  dlirunt  que 
1'avantage  majeur  d'un  langage  ivolut  eat  de  pouvolr  Stre  dcrlt  rnpidement  d'une  mnnifere  nature  lip, 
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Capendant  un  objectlf  a  <tl  lixt  qua  la  coefficient  de  foiaonnemant  na  dfpaaaa  paa  la  ehiffre  da 
',2  ratenu  auite  1  I'extcution  de  "Benchmarks"  particulars  at  aur  la  baae  d'lnforaatlona  fournie* 
par  le  constructeur  du  calculateur. 

Daa  recommendation*  one  alnal  ttt  fait**  i 

-  Evitor  d'utillaar  daa  calcula  loglqua*  aur  bita  at  an  particullar  daa  tablaaux  da  bita  indicia, 
caa  trAa  frfquanta  dana  laa  prograamaa  an  Aaaambleur. 

-  Effactuar  la  paasago  d'argumanta  1  daa  aoua-progratmta  par  "COMMON". 

t 

.Lea  program* »  one  alnal  ttt  Rcrit*  plua  rapidamant  qu'en  Aaaanblaur,  mala  certain*  program** 
de  loglqua  ont  dQ  Itre  lerita  pluaiauta  foit  afin  da  riduire  1*  coafficlant  da  foiaonnemant . 

La*  prograranaura  intarrogR*  aur  laura  prRfSranca*  quant  A  I'lcrltur*  an  FORTRAN  ou  an  Aaaanblaur, 
ont  glniralanant  dRrlarS  qu'il*  priflraiant  la  langaga  Aaaanblaur  pour  laa  program**  da  loglqua, 
at  la  FORT.cAN  pour  laa  calcula  nathSmatiquai. 

ta  difficult*  d'tcriture  da  programme*  da  loglqua  aat  cartainanent.  du*  aux  raatrictlor.a  impoaSaa 
concarnant  laa  ordrea  aur  bit*. 

L'avantaga  du  FORTRAN  pour  la*  calcula  aat  princlpalanant  dQ  A  la  auppraaaion  daa  p rob  Lima a 
de  cadraga. 

Certain*  progranoaur*  conaidftrent  qu'an  dRvaloppant  daa  macro-lnatruction*  adaptiar  4  laur 
problRtoa,  compte  tenu  de  la  rtpdtitivitfi  daa  tlquancaa,  la  facllit*  d'Rcrlture  an  Aaaambleur  aat 
comparable  1  ealle  du  FORTRAN.  C'eit  le  ca*  an  particullar  de  la  ainulatlon  du  pilot*  automatiqua. 

11  aat  A  noter,  at  ca  conmontair*  aat  bead  aur  una  grand*  experience  dot  Langaga*  Aaaaublaura 
portant  aur  da  nombtaux  calculateur*  utiliafa  pendant  lea  quina*  darnikra*  annSca,  qua  It 
langaga  aiiembleur  du  SEL  32  eat  particullAremant  facile  k  apprandr*  at  R  utlliaar. 

A. 4  Coefficient  da  folaonnaraant 


A. A. I  Introduction 


La  conaignc  donnfe  aux  programnaura  Rtait  de  riduix*  1*  pin*  poaalbl*  la  temps  da  calcul,  au 
detriment  Svuntuellement  du  nombre  de  toot*  ratimoire, 

II  eat  en  effat  plua  facile  d'augmenter  In  capacitS  mSmolra  qua  la  puiaaance  da  traitamant. 

Capendant  la  raSmoire  d'un  calculateur  devant  Stre  limitSe  R  I 28  Kmota  afin  d'avoir  un  adraaaag* 
diract  tana  pagination  de  la  tnSmnire,  la  capacitR  m6ntoira  na  doit  paa  Stra  "gaaplllRe". 

En  moyenne  lea  coefficient*  de  foiaonnament  mSmoire  at  tempa  de  calcul  aont  R  pau  prRa  equivalent* 
at  Sgaux  A  1,45. 

4.4.2  Programme  da  calcul 

Le  FORTRAN  eat  bien  adepts  A  1  'Scrlture  d ' uxpreaiiona  matliAmat iquea  et  le  compilateur  gSnlre 
un  coda  machina  preaque  equivalent  A  celui  Scrit  an  langaga  Aaaambleur,  Le  coefficient  de 
foiaemnament  ao  aitue  entra  1,05  at  1,10  pour  la  capacite  memoir*,  at  vara  1,30  pour  le  tamps  de 
calcul . 

Cette  augmentation  du  tampa  de  calcul  cat  due  aux  inatruction*  de  traitamant  en  virgula  flottnnte, 

Lea  aoua-programnea  ue  calcula  atandards  tola  qua  ainua,  cosinua,  racine  carrSe,  etc,.,,  ont  St t 
rSScrlt*  en  Aaaenbleur  avec  una  predator  InfSriaure  aux  aoua-programmee  FORTRAN  SF.L  afin  de 
reduira  la  tampa  de  calcul, 

11  en  aat  de  mama  de*  aoua-progranriai  de  calcula  de  fonctlona  d'une  ou  deux  variablea  par 
interpolation  llnfaire,  tris  utilieSa  dana  lea  calcula  aSrodynamiquo*  et  moteura, 

Lee  tablet  de  fonctlona  prennent  deux  foit  plua  da  mota  mSmoire,  lea  donnSea  Scant  aur  demi-raot 
en  Aasembleur  ce  qui  n'eat  paa  p<  aaible  en  FORTRAN, 

Lea  programme*  effectuant  uniquement  des  calcula  aont  rare*  dana  un  aimulateur  d'entrafnement 
at  raprSaentent  A  peine  10  X  de  l'enaemble  dea  programiuea. 

4.4.3  Prograimin  de  loglqua 

Aucun  programme  n'effectue  que  do*  calcula  de  logique.  Un  grand  nombre  do  programmes  ont  capendant 
une  part  predominante  de  traltementa  logiquea. 

de*  programmet  ont  en  moyenne  dea  coef f lcient a  de  ioiaonnement  variant  de  1,45  ft  1,75  avec  due 
exceptions  pour  dea  modules  ayunt  dot  truitementa  de  bita  obi igatoirea.  Atnsi  un  module  d'aflichage 
aur  indicateura  numSriquea  ii  un  coefficient  dc  fo iaonnemont  de  3  en  tempt  de  calcul. 

line  do*  raiaoiiB  de  l'oxpansion  du  code  gSndrd,  mitre  quo  cello  de  lu  mnnipulutlon  de  bits,  eat  In 
reatuurnt ton  dea  regletrea  ft  cheque  branchement,  trie  aouvent  difficile. 


Mlge  au  point  deg  programmes  et  modification* 

Le  programmeur  obtient  trie  rapidement  an  FORTRAN  un  prograrana  opdrationnel. 

La  pbaac  de  mise  au  point  du  1' analyst  en  centre  de  calcul  demande  des  moyens  plus  importanta 
qu'en  Assetnbleur, 

Le  programmeur  aouhaite  pouvoir  compiler  son  programme  lui-mlme  afin  de  tester  rapidement  une 
modification. 

II  est  alors  utile,  pour  Sviter  lea  manipulations  et  les  pertot  de  temps,  d'avoir  lo  fichier 
source  sur  disque  et  des  allocations  de  mdmoirea  centrales  suffisantes  pour  faire  une  compilation 
on  meme  temps  que  d'autrea  programmeurs  roettent  au  point  leur  programme. 

Dans  l'dfcat  d'avancement  du  projet,  il  est  trop  tSt  pour  porter  un  jugement  sur  la  mise  au  point 
en  temps  riel. 

CONCLUSIONS 

Un  simulateur  d'entralnement  au  pilotage  programme  en  langage  FORTRAN  sur  SEL  32  doit  avoir  une 
puissance  do  calcul  et  un  volume  mfmoira  50  1  aupdrieurs  au  mSme  simulateur  programme  en  lengege 
ABsembleur.  Ce  coefficient  auppose  que  let  programmes  soient  Merits  avec  un  FORTRAN  restraint, 
sens  faire  appal  aux  aoua-progranmes  standards  de  la  biblioth£que  FORTRAN. 

L' inconvenient  majeur  du  FORTRAN  dans  ce.  type  de  ayst&me  est  done  la  nSceasit.6  d'augmenter  la 
puissance  du  systSme  informatique  de  manUre  relativement  importante.  Cet  inconvenient  n'est  que 
parcieilement  compenaii  par  une  fac.ilite  de  programmation  molns  dvidente  que  le  luUserait  penser 
l'utilisatiou  courante  en  centre  de  citlcul  scientif ique. 

Le  constructeur  du  calculateur,  conaclent  de  ce  problems,  propose  actuellement  un  "accfilerateur 
scientif ique"  permettant  d'amfiliorer  de  manlere  importante  leu  tempa  d'exdcution  des 
aous-programmes  da  la  bibl lothfique  FORTRAN. 

I.'avantage  majeur  eat  1 'universality  du  langage.  11  semblo  que  cet  avantage  salt  intdressant 
surtout  pour  1 'utllisatour  qui  souhaite  modifior  les  programmes  de  manifire  asses  importante. 
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SUMMARY 

Extensive  research  is  being  carried  out  in  the  United  Kingdom  aimed  at  improving 
the  all  weather  operation  of  helicopters.  One  facet  of  this  work  iB  the  development  of 
night  vision  piloting  aids  to  enable  helicopters  to  operate  at  low  altitude  by  night. 

This  paper  describes  an  experiment  which  explored  the  problems  and  possibilities  of  a 
helmet  mounted  display  for  suoh  helioopter  night  piloting  tasks,  using  real  time  simula¬ 
tion  techniques. 

The  paper  describes  the  development  of  the  helioopter  simulation,  and  how  the 
various  components  of  the  proposed  night  viBion  Bystem  were  modelled  and  incorporated 
into  the  simulation,  to  provide  an  accurate  reproduction  of  the  proposed  airborne  system, 
and  an  acceptable  taBk  for  the  pilot  to  perform,  The  paper  disousses  the  experimental 
design  for  the  trials  and  how  the  limitations  of  the  simulation  were  taken  into  account. 
Finally,  the  results  of  the  work  are  described  and  how  these  have  helped  from  the  basis 
for  the  actual  airborne  system. 


1  INTRODUCTION 

The  helicopter  in  its  military  role  haB  the  ability  to  undertake  many  types  of 
operational  mission.  This  inherent  flexibility  of  operation,  which  1b  far  greater  than 
conventional  fixed  wing  aircraft,  depends  to  a  large  degree  on  the  pilot's  ability  to 
maintain  good  ground  oontact  in  order  to  recognise  and  identify  features.  When  this 
ground  oontact  is  prevented  by  low  scene  illumination  or  poor  visibility,  the  mission 
capability  is  removed  particularly  for  those  missions  involving  low  level  flight  at  or 
beiow  the  local  obstaole  clearance  level.  So  to  make  helicopter  poor  weather  or  night 
operations  possible,  it  is  not  solely  a  question  of  providing  suitably  processed  flight 
information,  as  is  the  case  for  some  types  of  fixed  wing  aircraft.  Rather  means  must  be 
devised  to  give  the  pilot  some  direct  or  indirect  view  of  the  outBide  world  to  re¬ 
establish  ground  contact  and  retain  the  mission  capability. 

Some  of  the  night  vision  systems  currently  proposed  require  little  or  no  aircraft 
modifications,  and  beaause  of  this  they  oan  be  assessed  in  an  airborne  environment  at  a 
reasonably  low  cost.  Other  systems  are  much  more  complex  however,  and  to  flight  teBt  an 
unproven  design  may  prove  to  be  very  expensive  and  also  very  wasteful,  if  the  original 
oonoept  had  a  major  design  weakness.  It  is  in  this  situation  that  the  flight  simulator 
aan  play  a  very  important  role  allowing  aB  it  does  airborne  systems  tc  be  evaluated  in  a 
controlled  environment  for  a  relatively  low  coBt. 

This  paper  desaribeB  a  night  vision  system  evaluation  and  development  in  a 
research  simulator  where  complexity  was  kept  to  an  absolute  minimum  commensurate  with 
ensuring  an  adequate  test  environment.  The  night  vision  concept  assessed  was  a  visually 
coupled  system.  In  the  airborne  system  this  would  comprise  a'  platform  mounted  sensor, 
a  helmet  mounted  display  which  presents  the  sensor  output  to  the  pilot,  and  a  head  sight¬ 
ing  system  whose  head  angle  outputs  continuously  direct  the  sensor  platform  to  the  pilot's 
line  of  sight.  In  addition  the  airborne  system  requires  a  waveform  generator  to  provide 
symbolic  flight  information  to  assist  in  pilot  knowledge  of  aircraft  attitude,  speed,  and 
height  etc  and  also  to  maintain  orientation  when  flying  on  the  helmet  display. 

The  simulator  basically  consisted  of  a  cockpit,  digital  computer  and  visual  flight 
attachment.  The  only  airborne  components  used  in  the  trials  were  the  helmet  display  and 
head  sighting  system.  A  ground  baaed  waveform  generator  was  used  to  provide  overlay 
flight  information  and  the  functions  of  the  platform  and  sensor  were  performed  by  the 
visual  flight  attachment.  These  latter  components  are  by  far  the  most  expensive  and 
complex  of  the  airborne  system,  and  this  was  where  the  major  cost  savings  were  made,  apart 
from  the  basia  trade  off  of  simulator  flying  hours  againBt  flight  hours. 

The  great  advantage  of  the  visually  coupled  system  over  alternative  forms  of  night 
vision  system  suoh  as  a  fixed  forward  looking  sensor  driving  a  head  down  display,  is  that 
it  provides  the  pilot  with  a  look  round  capability.  It  also  has  the  added  advantage  that 
the  image  of  the  outside  world  can  be  focussed  at  infinity  and  a  1:1  magnification  is 
possible  whereas  a  panel  mounted  display  normally  presents  a  demagnified  image  and  cannot 
easily  be  collimated.  Passive  night  goggles,  which  are  self-contained  image  intensifies 
mounted  on  the  pilot's  helmet,  al3o  provide  a  look  round  facility,  but  their  current 
capability  and  long  term  performance  development  are  ultimately  limited  by  the  sensor 
size.  The  effective  aperture  and  therefore  night  vision  performance  of  the  Bensor  in  the 
visually  coupled  system  is  only  limited  by  the  size  and  total  payload  constraints  of  the 
platform  and  vehicle. 


The  most  significant  human  faotor  problem  of  the  visually  coupled  system  is  caused 
by  the  present  design  monocular  viewing  systems.  This  was  the  area  where  the  flight 
simulation  was  most  effective  in  allowing  an  assessment  of  binocular  rivalry  and  dis¬ 
orientation.  Other  nystem  characteristics  investigated  were  platform  slew  rate  and 
overlay  fl'.ght  information  requirements, 

2  OBJECTIVES 

The  objectives  of  the  simulation  experiment  were  to  isolate  potential  problems  and 
develop  solutions  appropriate  to  flying  a  helicopter  by  night  at  low  level,  using  the 
visually  coupled  system  as  the  piloting  aid.  The  type  of  problems  envisaged  are:- 

(a)  disorientation  when  looking  off  track  caused  by  the  limited  outside  world 
peripheral  oues  and  the  monocular  display} 

(b)  asymmetric  weight  problems  due  to  the  monooular  display  being  mounted  on  the 
right-hand  side  of  the  helmet; 

(c)  cable  drag  resulting  in  restricted  head  movement  and  additionally  any  other 
equipment  use  problems. 

It  was  also  a  specific  objective  of  the  trial  to  establish  a  suitable  symbollo 
overlay  display  of  flight  information  to  assist  in  the  flying  task  and  maintaining 
orientation  and  to  determine  the  required  sensor  slew  rate. 

A  final  signifioant  area,  where  the  flexibility  of  the  simulator  was  used  to  the 
full,  was  in  the  assessment  of  the  level  of  aircraft  stabilisation  required  to  produce  an 
acceptable  pilot  workload  when  flying  at  low  level. 

3  VISUALLY  COUPLED  NIOHT  VISION  SYSTEM 

In  the  normal  airborne  installation,  the  visually  coupled  aystem  comprises  a  head 
sighting  system  ooupled  to  a  slewable  platform  in  the  nose  of  the  airoraft.  Within  this 
platform  a  suitable  night  vision  sensor  is  mounted,  either  low  light  television  (LLTV)  or 
forward  looking  infra-red  (FLIR) .  The  sighting  system  measures  pilot  head  angular 
orientation  in  elevation  and  azimuth,  and  these  slgnalB  are  fed  to  the  platform  so  that 
the  night  vision  sensor  is  looked  to  the  pilot's  line  of  sight.  The  aensor  output  is  fed 
to  a  helmet  mounted  display  which  presents  to  the  pilot  a  oollimated  soene  image  at  unity 
magnification.  As  the  pilot  moves  his  head,  the  platform  follows  (up  to  the  gimbal 
limits)  giving  a  oontinuous  view  of  the  outside  world,  aB  if  the  pilot  were  looking 
through  the  windscreen.  Typically,  the  system  provides  an  instantaneous  field  of  view  of 
40°  with  an  area  of  coverago  from  the  platform  of  ±100°  in  azimuth  and  +20°  to  -110°  in 
elevation.  Because  of  the  elevation  coverage,  the  pilot  oari  actually  "look  through  the 
floor"  of  the  helicopter  vertically  downwards.  Provided  potential  disorientation  effects 
oan  be  overcome,  the  visual  ooverage  at  night  is  muoh  greater  than  with  passive  night 
goggles.  This  oan  be  very  advantageous  during  searoh  and  rescue  missions  or  when  landing 
in  a  restricted  site. 

It  HELICOPTER  SIMULATION 

The  assessment  of  the  helmet  mounted  display  system  was  carried  out  using  a  fixed 
base  digital  simulation  of  the  Lynx  helicopter  (WQ  13).  The  mathematical  model  was  based 
on  the  full  flight  equations  of  a  Lynx  helicopter  developed  by  V.'estlands.  Although  these 
were  originally  written  for  an  analogue  maohine  they  were  found  to  be  perfeotly  adequate 
for  the  present  trials  after  translation  into  suitable  digital  maohine  language.  The 
digital  oomputer  used  was  the  Redifon  2000A  24  bit  maohine  which  has  an  iteration  rate  of 
18  Hz.  The  flight  programme  only  oooupied  some  2000  words  of  core  storage,  but  gave  a 
full  six  degrees  of  freedom  simulation  from  the  hover  up  to  160  kn.  The  digital  oomputer 
was  ooupled  to  an  analogue  to  digital,  and  digital  to  analogue  input/output  interface 
ByBtom  which  handled  Btiok  and  collective  inputs  etc,  and  provided  output  drives  to  a 
visual  outside  world  presentation  and  the  flight  instrument  displays. 

4.1  Cockpit 

The  simulator  oockpit  shown  in  Pig  1  was  a  fixed  base  representative  wooden  mook-up 
of  the  front  of  the  Lynx  helicopter.  This  was  sited  in  an  area  which  oould  be  darkened 
to  simulate  night  conditions,  and  whioh  was  isolated  from  the  oomputer  and  control  room. 

A  representative  intercom  system  was  used  to  oommunioate  with  the  pilot  whilst  he  was 
flying  the  various  tasks. 

The  subjeot  pilot  flew  the  simulator  using  representative  oyolio,  oolleotive  and 
rudder  controls.  A  pitch  and  roll  trimming  facility  was  provided  by  means  of  a  Bwitoh  on 
the  stick  top.  Because  the  cyclic  control  was  very  simple  comprising  a  Bpring  feel 
system  with  potentiometer  piok-offs,  operating  the  trim  switoh  did  not  move  the  stick  b.b 
in  the  normal  airoraft,  but  simply  added  a  small  digital  increment  to  the  existing  control 
input  in  the  programme  for  eaoh  iteration  of  the  computer.  This  was  a  slight  limitation 
since  the  cockpit  was  not  fitted  with  trim  gauges,  and  in  consequenoe  the  pilot  oould 
'trim'  the  helioopter  to  one  end  of  the  control  run  and  run  out  of  control  authority  with¬ 
out  realising  it. 

The  only  Instrumentation  in  the  oookpit  was  a  0.2Bm  diagonal  television  monitor 
whioh  presented  the  simulated  outside  world  terrain  image,  together  with  superimposed 
flight  information  provided  by  a  programmable  symbol  generator.  This  head  down  display 
replaced  the  normal  conventional  oockpit  instruments,  this  meant  that  a  study  oould  not  be 


made  of  the  effeot  on  performance,  when  using  the  visually  coupled  system  and  attempting 
to  read  the  head  down  instruments. 

Two  press  to  make  switches  were  installed  in  the  central  cockpit  console  for  a  fixed 
route  navigation  task  described  in  section  6.2.  One  was  to  select  a  new  waypoint,  the 
other  to  display,  on  the  overlay  flight  information,  the  required  heading  to  steer  to  the 
next  way  point.  (The  overlay  display  used  at  the  start  of  the  trial  1b  described  in 
section  6  and  its  subsequent  development  described  in  section  7.3 

4.2  Visual  flight  system 

The  simulated  outside  world  was  provided  by  a  dosed  oirouit,  television  system  which 
comprised  a  camera  viewing  a  oontoured  modelled  belt,  scaled  at  3000:1.  Fig  2  is  a  photo¬ 
graph  of  the  belt,  and  camera  gantry  system.  This  soaling  was  just  adequate  to  provide 
realistic  contouring  and  reasonable  simulation  of  airfields ,  towns,  woods  etc.  The  belt 
was  11.5  m  long  by  3  m  wide,  providing  a  usable  scaled  area  for  flight  of  34,5  km  by  9  km, 
but  because  the  belt  was  driven  in  a  continuous  loop,  a  numerous  number  of  possible 
flight  paths  over  different  terrain  were  possible.  Fig  3  shows  a  map  of  the  terrain  and 
the  waypoints  and  navigation  route. 

Helicopter  forward  velocity  was  represented  by  a  combination  of  belt  speed  and 
oamera  lateral  velocity.  Height  was  represented  by  aamera  displacement  above  the  terrain. 
The  oamera  viewed  the  modelled  terrain  via  an  optioal  probe,  which  reproduced  aircraft 
pitoh,  roll  and  heading  changes.  The  inputs  to  the  various  angular  and  linear  servo 
Bystems  was  provided  by  ground  axis  transformation  algorithms  in  the  oomputer  programme, 
via  the  digital  to  analogue  converter  interfaces. 

Because  of  the  mechanical  arrangement  of  the  oamera  gantry  and  belt,  the  available 
heading  sector  available  for  flight  waR  only  190°,  This  meant  that  complete  oiroults 
oould  not  be  flown  and  that  large  off  centre-track  heading  changes  could  not  be  maintained 
very  long  without  the  camera  reaching  the  side  of  the  belt.  Due  to  the  design  of  the 
oamera  optical  probe,  there  was  a  limited  full  soale  deflection  of  ±20°  of  bank  angle  and 
±25°  of  elevation  angle.  The  restriction  in  elevation  angle  prevented  an  assessment  of 
the  "through  the  floor"  oapability  envisaged  in  the  airborne  visually  coupled  system, 
but  this  did  seriously  detract  from  the  value  of  the  experiment. 

The  closed  oirouit  television  oamera  had  a  zoom  lens  arrangement  allowing  outside 
world  fields  of  view  from  60°  to  15°.  For  the  present  trials,  this  system  was  adjusted 
to  give  e  field  of  view  of  40  in  azimuth  by  30°  in  elevation  on  both  the  panel  mounted 
and  helmet  mounted  displays,  since  this  had  been  found  from  previous  trialB  to  provide 
an  acceptable  compromise  of  field  of  view  and  resolution  for  the  low  level  piloting  task. 
At  the  normal  viewing  distanoe  the  panel  mounted  monitor  only  BUbtended  17.5°  by  13°  at 
the  pilot's  eyes,  giving  an  image  magnification  of  0.44.  When  flying  on  the  helmet 
display  the  pilot  had  a  full  1:1  image  magnification,  whioh  proved  to  bo  of  some  advantage 
during  the  trials. 

Despite  the  long  depth  of  focus  provided  by  the  f/64  relative  aperture  of  the 
oamera  optios,  an  additional  automatic  focus  facility  was  built  into  the  system.  This 
was  driven  by  airoraft  height  to  keep  the  middle  foreground  of  the  image  in  focus  at  all 
times . 


One  particular  feature  of  the  simulator,  which  assisted  greatly  in  the  realism  of 
the  flying  task  was  the  'radio,  height'  Bystem,  This  was  achieved  by  measuring  the  height 
of  the  terrain  on  a  grid  system  of  5  cm  squares  over  the  whole  terrain.  Each  height 
value,  together  with  its  X  and  Y  position,  waB  then  Btored  in  the  digital  computer. 

UBing  the  X  and  Y  position  feedback  signals  from  the  belt  and  correlating  these  with  the 
stored  grid,  the -computer  was  able  to  output  a  continuous  radio  height  signal,  wherever 
the  helicopter  was  over  the  terrain. 

5  HELMET  MOUNTED  DISPLAY 

The  only  parts  of  the  normal  airborne  Bystem  which  were  used  in  the  simulation  wore 
the  head  sighting  unit  and  helmet  mounted  display  and  associated  drives.  The  aotion  of 
the  platform  mounted  sensor  was  simulated  by  driving  the  oamera  and  optical  probe  of  the 
simulated  outside  world  in  a  suitable  manner  as  described  below. 

The  head  sighting  Bystem  and  helmet  display  were  manufactured  by  Honeywell  and  are 
illustrated  in  Fig  1  in  position  in  the  uookpit.  The  head  sighting  system  basically 
consisted  of  two  sensor  surveying  units  (SSU)  mounted  eaoh  side  of  the  pilot's  head  which 
produced  horizontal  fan  shaped  infra  beams,  which  swept  in  an  arc  downwards  through  the 
cockpit.  These  beams  were  detected  by  a  pair  of  photo-transistors  mounted  horizontally 
with  a  separation  of  150  nun  on  one  side  uf  the  helmet,  together  with  a  corresponding  pair 
on  the  other  side.  Eaoh  SSU  produoed  two  synchronised  infra-red  fans  separated  vertically 
by  about  100  mm.  The  intersection  of  these  beams  with  the  phototranBistors  generated 
pulses  whose  timing  rolative  to  the  start  of  the  scan  was  used  to  calculate  the  helmet 
attitude  relative  to  the  SSU,  Axis  transformation  calculations  were  then  performed  to 
oonvert  the  SSU  referred  angleB  to  head  elevation  and  azimuth  angles  relative  to  the 
cookpit.  In  the  simulator,  a  further  stage  of  axis  transformation  had  to  be  performed 
to  convert  these  oockp.it  or  airoraft  axoB  angles  to  ground  axes.  The  ground  referred 
head  azimuth  and  elevation  angleB  were  then  simply  added  to  the  normal  airoraft  heading 
and  pitch  angles  respectively,  arid  then  fed  to  the  outside  world  camera  optioal  probe. 
Whatever  the  attitude  of  the  airoraft,  the  optioal  probe  responded  as  if  it  were  a  two 
degree  of  freedom  sensor-  platform  mounted  ■  the  aircraft.  With  the  camera  output 
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presented  on  the  Honeywell  helmet  mounted  display,  the  pilot  had  an  instantaneous  field 
of  vie«  of  40°  of  the  outside  world  at  unity  magnification,  focussed  to  infinity. 

The  helmet  display  was  mounted  horizontally  along  the  bottom  edge  of  the  right  hand 
side  of  the  helmet.  The  25mm  CRT  contained  within  the  unit  was  viewed  via  in-line 
oollimating  optics  and  a  reflector  plate  as  illustrated  in  Pig  4.  As  with  all  ourrent 
designs  this  helmet  mounted  display  was  monocular,  the  outside  world  image  only  being 
viewed  by  the  pilot's  right  eye.  This  not  only  gave  rise  to  asymmetric  weight  problems, 
but  also  produced  severe  operating  problems  as  disauased  later. 

5.1  Overlay  flight  information 

It  was  anticipated  prior  to  the  start  of  the  trials,  that  it  wo\jld  be  extremely 
advantageous  for  the  pilot  to  have  some  basic  flight  information  superimposed  on  his 
forward  view  of  the  terrain;  not  only  to  assist  in  the  basic  piloting  task,  but  also  to 
aid  orientation  when  looking  off-traok  with  the  helmet  display.  The  basic  overlay  flight 
information  format  investigated  during  the  trial  is  shown  in  Pig  5-  Pitch  and  roll 
attitude  were  presented  in  the  oentre  of  the  display  by  an  artificial  horizon  referenced 
to  an  aircraft  symbol  with  pitah  and  roll  soales.  Radio  height  in  feet  and  Bpeed  in  knots 
were  indicated  as  digital  readouts  at  the  bottom  right  and  left  of  the  display,  respec¬ 
tively.  Airoraft  heading  was  shown  as  a  horizontal  linear  tape  in  10°  increments  along 

the  bottom  of  the  display,  and  vertioal  speed  was  presented  at  the  right  hand  side  b,y 
means  of  a  thermometer  read  against  a  vertioal  soale,  where  eaoh  index  from  the  datum 
represented  an  increment  of  250  ft/min.  The  final  primary  flight  symbol  presented  was 
sideforoe,  indicated  by  the  displacement  of  an  ellipse  moving  against  the  heading  marker. 

As  described  in  the  following  section,  the  pilot  was  given  a  navigation  task  as  a 

part  of  the  trial,  and  to  ense  the  total  workload,  the  navigation  information  was  also 

presented  on  the  helmet  mounted  display  as  shown  in  Pig  5.  This  consisted  of  the  number 
of  the  waypoint  currently  being  approached,  presented  at  the  top  left  of  the  display  and 
immediately  below  this  the  range, in  nautical  miles,  from  the  helioopters  present  position 
to  this  waypoint.  Additionally,  a  heading  to  steer  bug  driven  horizontally  on  the  head¬ 
ing  tape,  gave  a  continuously  computed  readout  of  the  heading  to  steer  to  reaoh  the  way- 
point  from  the  heliaopter's  present  position. 

The  drives  to  this  navigation  system  were  produced  by  an  especially  written  soft¬ 
ware  programme  whioh  sought  to  emulate  the  function  of  an  airborne  Doppler  navigation 
computer.  The  programme  only  ocoupied  some  300  machine  instructions  and  relied  for  its 
operation  on  the  knowledge  of  aircraft  present  position  in  X  and  Y,  from  the  belt  and 
camera  feedback  system,  and  the  X  and  Y  positions  of  the  18  different  waypoints.  Knowing 
the  waypoint  selected,  a  simple  geometric  algorithm  wbb  used  to  oaloulato  the  range  and 
bearing  of  that  waypoint  from  the  airoraft  present  position,  and  output  these  signals  to 
the  waveform  generator. 

The  overlay  display  was  produced  by  a  outlive  programmable  waveform  generator  whioh 
had  a  1000  word  24  bit  programme  store  and  a  1000  word  8  bit  symbol  store.  The  primary 
display  symbol  drives  were  provided  by  the  main  oomputer  via  a  digital  to  analogue/ 
analogue  to  digital  interface  unit.  (Direct  digital  drive  was  not  possible  in  this  case 
beoause  of  incompatibilities  in  the  digital  word  structure  between  the  two  machines.) 

The  main  programme  capability  in  the  waveform  generator  was  used  to  perform  datum  and 
scaling  functions  and  to  call  up  the  required  characters  Trom  the  symbol  store.  The 
output  from  the  waveform  generator  was  presented  on  a  cursive  head  down  display  which 
was  viewed  by  a  nuvicon  television  camera  to  provide  a  soan  converted  raster  output  for 
mixing  with  the  video  signal  from  the  model  terrain  camera.  This  composite  mixed  video 
was  then  fed  both  to  the  head  down  monitor  in  the  oookpit  B.nd  the  helmet  mounted  display. 

6  EXPERIMENT*1.  DESIGN 

Due  to  the  limitations  of  the  simulator,  (t'e  laok  of  motion  cues  and  limited  model¬ 
ling  of  the  normal  airoraft  instruments),  it  was  realised  that  the  successful  outcome  of 
the  trials  depended  to  a  great  extent  on  the  experimental  design  adopted.  To  minimise 
the  effect  of  simulator  limitations  a  comparison  exercise  was  carried  out  between  the 
head  down  display  (for  whioh  flight  trial  results  were  already  known)  and  the  helmet 
mounted  system.  Additionally,  great  care  was  taken  to  ensure  that  the  pilots  were 
thoroughly  familiar  with  the  simulator  and  the  task  to  be  performed,  before  the  trials 
started,  The  subsections  below  desoribe  in  detail  the  techniques  adopted  and  the  measure¬ 
ments  taken  to  provide  a  sound  basis  for  any  subsequent  trials  of  the  equipment, 

6.1  Pilots'  briefing  and  familiarisation 

Prior  to  the  experiment,  each  participating  pilot  was  given  a  written  brief  which 
de.'Baribed  the  helmet  mounted  display  and  overlay  data,  and  gave  an  outline  of  the  experi¬ 
ment,  its  objectives  and  an  indication  of  what  each  task  entailed,  They  were  also  asked 
to  study  a  comprehenolvp  questionnaire,  to  be  completed  after  the  experiment,  given  a 
copy  of  the  navigation  route  (Fig  3)  and  a  Cooper  Harper  rating  sheet  shown  in  Fig  6. 

Initially  a  period  of  time  was  spent  in  allowing  each  pilot  tD  beoome  familiar  with 
the  equipment.  This  involved  flying  the  helicopter  on  the  head  down  display  with  and 
without  the  look  round  faoility.  The  pilots  participating  in  the  experiment  had  varied 
flying  experience  and,  of  oourse,  different  learning  ourveo.  Thio  oreatud  the  difficulty 
of  deciding  how  much  practice  time  eaoh  pilot  required  to  ensure  that  all  of  them  were  at 
the  same  level  of  performance  before  undertaking  the  tasks.  As  a  simple  measure  of  task 


proficiency  each  pilot  had  to  keep  his  height  over  the  terrain  to  between  150  ft  and 
250  ft  agl  for  5  minutes,  when  flying  the  navigation  task. 

6.2  Piloting  tasks 

There  were  two  major  tasks  that  the  pilots  were  given  to  fly.  The  first  was  a 
reconnaissance  exercise  and  involved  flying  the  specified  route  shown  in  Fig  3,  over  the 
18  waypoints  using  the  navigation  information  presented  on  the  overlay  display.  In  order 
to  make  each  waypoint  readily  identifiable  a  specific  ground  feature  was  modelled  at  each 
one.  A  list  of  these  is  shown  on  the  map  in  Fig  3. 

To  simulate  a  reconnaissance  operation  the  pilot  wrb  required  to  spot  and  verbally 
identify  as  many  off-track  targets,  i«  simulated  tanks,  as  possible.  By  tape  recording 
the  tasks,  a  scoring  could  be  taken  of  the  number  identified. 

The  second  task  was  a  simulated  anti-tank  operation,  which  *'as  to  locate  and  then 
fly  to  a  specified  number  of  tanks  in  as  short  a  time  as  possible.  This  simulated  a 
target  search  operation  with  no  defined  route.  The  positions  of  the  tanks  for  both 
operations,  are  shown  in  Fig  7.  This  information  was  not,  however,  supplied  to  the 
pilots,  prior  to  the  experiment.  The  purpose  of  both  tasks  was  to  make  the  pilot  look 
off-track,  so  that  a  study  of  the  helmet  mounted  display  in  its  major  role  could  be  made. 
The  3000  to  1  scaling  of  the  terrain  model  caused  great  problems  in  the  modelling  of  the 
tanks.  Tanks  of  the  required  scaling  were  so  small,  that  it  was  not  possible  to  make 
them  with  sufficient  detail  to  allow  them  to  be  identified  when  flying  over  the  terrain. 

To  overcome  this  problem,  the  tanks  were  made  double  size  to  ensure  that  they  could  be 
positively  identified.  Although  this  reduced  the  authenticity  of  the  trial,  it  was  felt 
to  be  an  acceptable  procedure  sinoe  it  in  no  way  invalidated  the  comparison  between  the 
head  down  and  helmet  mounted  displays.  Both  tasks  were  flown  in  the  height  range  from 
150  ft  to  250  ft  using  the  head  down  display,  the  helmet  display  without  the  look  round 
facility  (ie  simulating  a  fixed  forward  sensor)  and  the  helmet  display  with  the  look 
round  facility. 

By  processing  six  pilots  at  a  time,  a  6  x  6  latin  square  sequence  could  be  used  on 
the  tasks  to  be  performed.  This  ensured  that  residual  learning  effects  and  any  biases 
in  the  results  oaused  by  performing  the  taskB  in  a  oonstant  speoifio  order,  were 
minimised . 

6.3  Recording  and  analysis  of  trials  results 

This  experiment  was  intended  to  be  the  first  in  a  serieo  of  trials  to  study 
visually  ooupled  systems.  As  such,  it  was  felt  that  a  primarily  subjective  assessment 
of  the  helmet  mounted  display  would  give  moBt  feedhaok,  provided  that  this  was  sought  in 
the  most  efficient  way.  More  objective  trials  could  then  be  staged  which  would  concen¬ 
trate  on  the  important  areas  highlighted  by  these  initial  results.  To  achieve  this  feed¬ 
back,  a  structured  questionnaire  was  produced  which  sought  pilot  opinion  on  all  aspects 
of  the  system.  Although  many  of  the  questions  in  this  were  multiple  choioe,  the  pilot 
was  encouraged  to  add  additional  oomments  to  amplify  his  answers. 

In  order  to  quantify  the  difficulty  of  eaoh  task,  the  pilotB  were  asked  to  apply  a 
Cooper  Harper  rating  to  each  one  (Fig  6).  In  this  evaluation  approaoh,  which  was 
originally  developed  to  assess  aircraft  handling  qualities,  a  pilot  selects  one  of  ten 
categories  of  system  acceptability,  which  most  nearly  describes  hiB  own  view.  This  pro¬ 
vides  a  rapid  assessment  technique  which  oan  be  equally  applied  to  display  system 
selection . 

7  ANALYSIS  AND  DISCUSSION  OF  RESULTS 

Most  of  the  results  discussed  below  were  obtained  from  the  pilots'  questionnaires 
and  are  set  down  in  the  sequenoe  used  for  debriefing,  starting  with  the  simulation  and 
moving  on  to  the  individual  tasks  and  then  to  the  equipment  itself. 

7.1  Flight  simulation 

All  participating  pilots  were  unanimous  in  the  view  that  the  flight  simulator  was 
adequate  for  the  display  system  comparison  task.  There  were,  however,  a  number  of 
deficiencies  which  detracted  from  the  realism  of  the  system,  and  whioh  they  felt  needed 
improvement . 

In  terms  of  the  handling  qualities,  it  was  found  initially  that  changes  in  collect¬ 
ive  pitch  produced  too  large  a  ohange  in  longitudinal  aircraft  pitoh,  and  that  the  rolling 
moment  produced  by  sideslip  was  far  too  small.  Once  these  cross-coupling  terms  were 
modified,  the  responses  of  the  vehicle  to  collective  and  cyclic  control  inputs  wore  felt 
to  be  reasonably  representative  of  a  Lynx  type  helicopter. 

In  terms  of  agility,  there  was  found  to  be  reduoed  response  of  vertioal  speed  to 
aft  cyclio  incuts  at  speeds  below  100  kn  compared  with  the  actual  aircraft.  This  meant 
that  when  ai  proaching  rising  ground  both  collective  and  cyclic  inputs  had  to  be  made  in 
order  to  crest  a  hill,  and  this  imposed  an  additional  pilot  workload,  whioh  would  not 
be  present  in  the  real  airoraft. 

The  other  important  factor  which  contributed  to  the  difficulty  of  the  general 
handling  task  was  the  lack  of  a  representative  trimming  system.  As  diBoussed  in 
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section  4.1,  stiok  trim  signals  were  added  directly  to  the  software  control  input,  rather 
than  by  moving  the  stick.  Although  this  was  believed  to  be  a  limitation,  it  did  not 
seriously  undermine  the  value  of  the  experiment  as  will  become  apparent  from  the  results 
obtained  from  the  trials. 

The  absence  of  other  normal  flight  cues  such  as  motion,  noise  and  vibration 
inevitably  detracted  from  the  realism  and  increased  the  task  difficulty  to  some  extent, 
by  oausing  the  pilots  to  over-control  initially,  due  to  the  lack  of  vestibular  phase 
advance  information.  Overall,  however,  it  was  felt  that  the  flight  simulation  was  an 
adequate  assessment  medium  for  the  comparison  exercise,  especially  since  the  experiment 
was  aimed  at  assessing  concepts  and  establishing  principles,  rather  than  obtaining  preoise 
quantitative  data. 

The  only  other  significant  problem  related  to  the  simulation,  highlighted  during 
the  trials  was  the  lack  of  texture  in  the  image  from  the  outside  world  camera.  (Texture 
in  this  case  means  rocks,  grass,  small  bushes  etc.)  Because  of  the  3000:1  scaling  the 
reproduction  of  such  detail  was  almost  Impossible,  and  since  a  pilot  normally  relies  on 
such  details  to  accurately  gauge  aircraft  height,  more  relianoe  had  to  be  plaood  on  the 
overlay  flight  information  than  would  normally  be  the  oase.  The  problem  was  particularly 
noticeable  when  flying  towards  rising  ground,  and  was  further  compounded  by  the  faot  that 
the  immediate  foreground  tended  to  go  out  of  focus,  due  to  the  dose  foous  limitation  of 
the  visual  system. 

Although  these  criticisms  were  perfectly  valid  when  applied  to  a  simulation  whioh 
sought  to  accurately  reproduce  the  outside  world,  lack  of  texture,  ia  lack  of  ground 
feature  resolution,  is  frequently  a  characteristic  of  night  vision  sensors,  especially 
those  providing  a  large  azimuth  field  of  view.  Thus  in  this  particular  instance,  the 
lack  of  ground  feature  resolution  made  the  simulation  to  some  degree  more  representative 
of  the  actual  airborne  system. 

In  General,  the  pilots  found  the  reconnaissance  and  anti-tank  taBks  both  motivating 
and  representative  of  an  operational  task.  Some  problems  were  experienced  in  the  latter 
stages  of  the  navigation  task,  due  to  the  waypoints  being  too  close  together  and  requiring 
large  heading  ohanges  to  go  from  one  to  the  other,  The  other  significant  faotors,  whioh 
the  pilots  felt  affected  their  performance  were  learning  ourve  and  fatigue.  The  criteria 
adopted  for  determining  equal  profioienoy  did  not  guarantee  that  all  pilots  had  surmounted 
the  learning  ourve.  Because  of  this,  some  felt  that  more  practice  time  would  have  been 
beneficial.  On  the  other  hand  the  total  task  was  found  to  be  very  fatiguing,  so  that  in 
many  instances  more  praotioe  time  would  have  meant  that  the  pilots  were  becoming  tired, 
before  they  had  even  started  the  proper  experiment. 

7.2  Display  comparison 

.In  the  questionnaire  the  subjeot  pilots  were  asked  to  comment  on  a  number  of  issues 
whioh  related  to  the  ease  or  difficulty  of  performing  the  set  tasks  using  the  helmet 
mounted  display  aompared  with  the  head  down  display. 

Without  the  head  sighting  system  in  operation,  the  helmet  display  presented  the 
same  image  as  the  head  down  display  at  all  times.  In  oomparing  these  two  oonoepts,  the 
pilots  generally  agreed  that  perceptually ,  both  forms  of  display  gave  reasonably  adequate 
height  and  distanoe  cues.  In  isolation,  the  helmet  display  was  preferred,  beoause  of  its 
collimated  1:1  image  which  was  much  more  natural  to  view  than  the  head  down  display, 
whore  the  image  magnification  was  only  0.44,  This  preferenae  was  off-set  overall  by  two 
significant  factors;  firstly,  that  the  helmet  displny  was  monocular,  which  meant  that 
totally  disparate  information  in  two  different  focal  planeB  was  presented  to  each  eye, 
and  secondly  that  there  were  occasional  problems  obtaining  a  sharp  in-foous  image  whioh 
oaused  additional  image  resolution  loos.  The  implications  of  those  factors  are  discussed 
more  fully  in  section  7.6. 

With  the  head  sighting  system  in  operation  the  pilots  found  that  the  problems  in 
the  piloting  and  navigation  task  caused  by  the  fixed  narrow  field  of  view  were  removed. 

It  was  possible  to  look  into  a  turn  before  executing  it,  whioh  improved  with  oonfidenoe, 
and  onoe  fully  familiarised,  more  ground  features  could  be  used  for  navigation.  When 
approaching  a  way  point  with  the  aircraft  off  track,  for  example,  the  look  round  facility 
enabled  it  to  be  easily  spotted  and  heUd.  With  a  fixed  forward  view,  the  particular 
ground  feature  oould  be  lost  completely,  and  in  the  actual  airborne  system  a  oircuit  would 
be  required  to  relooate  it, 

With  the  head  sighting  system  coupled  to  the  simulated  platform,  the  first  major 
aspect  whioh  was  discovered  was  that  platform  slew  rates  and  accelerations  were  critical, 
if  pilot  orientation  was  to  be  maintained.  In  the  simulator,  platform  motion  was  simu¬ 
lated  by  the  optical  servo  system  of  the  dosed  oircuit  television  system,  as  described 
in  seotion  5.  The  response  of  this  Bervo  oould  be  easily  altered  to  represent  different 
platform  responses.  It  was  found  that  in  order  to  prevent  perceivable  lag  the  platform 
required  a  slew  capability  of  120°/s  from  start  to  stop  and  had  to  be  critically  damped 
to  prevent  overshoot  or  undershoot.  To  meet  this  speoifioation  the  platform  required  an 
angular  aooeleration  capability  of  900Q-1000o/s2 . 

When  syBtern  lags  were  present,  the  pilot  was  forced  to  reduce  his  normal  head 
rotation  rate  to  keep  the  platform  in  step,  and  this  not  only  added  to  the  general  task 
level,  but  prevented  the  pilot  identifying  targets  of  opportunity.  This  problem  was 
highlighted  when  flying  at  very  low  level,  since  small  undetected  descent  rates  oould 
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quickly  increase,  whilst  the  pilot  was  looking  off-track,  resulting  at  best  in  large 
uncontrolled  collective  inputs,  and  at  worse  in  a  crash.  Even  with  the  system  optimised, 
where  platform  lag  for  an  off-axis  glance  at  90°  was  no  more  than  0.1  s,  there  was  a 
tendency  for  the  pilot  to  instinctively  increase  height  due  to  the  lack  of  peripheral 
vision.  Although  this  problem  reduced  with  familiarisation,  it  was  not  minimised  until 
the  overlay  symbology  was  modified  as  described  below, 

Another  important  requirement  established  whilst  determining  the  platform 
characteristics,  was  the  need  for  inner  loop  stabilisation  on  the  helicopter.  The 
simulation  wap  originally  set  up  with  a  simple  rate  damping  Bystem.  With  the  relatively 
low  degree  of  augmentation  that  this  provided,  the  pilot  could  easily  induce  an  unin¬ 
tentional  pitohing  or  rolling  moment  whilst  looking  off  to  the  left  or  right.  This 
problem  was  further  compounded  by  the  lack  of  motion  cues  or  peripheral  vision. 

This  was  one  area  where  the  flexibility  of  the  simulator  was  fully  exploited,  and 
it  was  found  that  the  provision  of  an  attitude  trim  term  in  the  stabiliser  oontral  laws 
minimised  the  problem,  and  gave  the  pilot  confidence  to  look  off  track  nor.’  frequently. 
Although  this  may  have  also  been  solved  by  providing  a  continuous  r^d-out  of  attitude 
wherever  the  pilot  looked,  this  was  found  not  to  be  acceptable  as  d’  assed  in  the  next 
section. 

Operationally,  the  pilot  would  have  the  motion  cues  not  present  in  the  simulator, 
but  would  not  have  normal  peripheral  vision  when  using  the  helmet  display.  Although  it 
would  need  confirmation  in  an  airborne  trial,  it  is  believed  that  an  attitude  stabilisa¬ 
tion  system  on  the  helicopter  would  be  mandatory  when  flying  on  the  helmet  mounted  dis¬ 
play  at  low  level,  in  order  to  maintain  an  acceptable  level  of  task  difficulty. 

7.3  Overlay  flight  information 

Apart  from  platform  head  following  rates  another  souroe  of  disorientation  when 
using  the  visually  coupled  system  was  that  the  pilots  had  initial  difficulty  in  resolving 
the  difference  between  aircraft  heading  changes  and  head  azimuth  movements,  since  both 
produced  the  same  effect  to  the  image  presented  to  the  right  eye.  In  addition  when 
looking  far  off  axis,  although  tho  inside  of  the  cockpit  could  be  seen  by  the  left  eye, 
the  concentration  on  the  display  image  was  suoh  that  the  pilot  would  be  unsure  whioh 
position  to  return  to,  to  establish  the  helicopter  attitude.  When  the  overlay  flight  in¬ 
formation  was  added,  (as  shown  in  Pig  5)  this  resolved  some  of  the  problems,  but  there 
then  arose  the  question  of  whether  the  flight  information  Bhould  move  with  the  head,  or 
remain  boresighted  to  the  cockpit  in  some  manner,  It  was  quickly  established  that  the 
latter  procedure  minimised  any  disorientation  effects,  Allowing  the  flight  information 
to  move  with  the  head  overcame  the  objection  described  above,  of  not  knowing  the  aircraft 
attitude  when  looking  off  to  the  side,  but  compounded  the  disorientation  effoot, 

To  implement  the  cockpit  stabilised  overlay  display,  tho  head  offset  angles  in 
azimuth  and  elevation  were  uoed  to  drive  tho  overlay  information  aoross  the  CRT  face  of 
tho  helmet  display  to  correspond  one  for  one  in  angular  subtense  to  the  offset  of  the 
optioal  servo  on  the  camera.  To  prevent  the  overlay  information  disappearing  off  the 
CRT  for  large  head  offsets,  the  drive  signals  were  limited  so  that  one  edge  of  the  flight 
information  could  always  be  seen.  In  this  way  the  pilot  always  knew  in  whioh  direction 
to  move  his  head  to  re-establish  the  boresight.  The  only  refinement  made  to  this  concept 
during  the  course  of  the  trials  was  that  the  aircraft  radio  height  was  not  driven  in  this 
way,  so  that  it  remained  in  the  same  position  in  the  pilot's  instantaneous  field  of  view 
of  the  CRT.  With  this  height  readout  always  present,  tho  pilot  knew  immediately  if  the 
ground  clearance  was  reducing  when  looking  to  the  side. 

In  general,  the  content  and  form  of  presentation  of  the  overlay  display  wqb  liked 
by  the  pilots.  The  digital  readouts  for  speed  and  height  could  be  easily  read,  although 
they  lacked  trend  information.  Although  not  important  for  the  speed  readout,  it  was 
suggested  that  a  counter  pointer  height  presentation  would  imi  eve  rapid  appreciation  of 
changes  in  clearance  height.  The  incorporation  of  the  navig.i'  Lon  information  on  the 
display  did  not  give  rise  to  any  scan  problems,  l'n  fact,  it  ,ias  agreed  that  the  total 
format  gave  the  pilot  all  the  continuous  information  needed  to  fly  the  task. 

7 . t  Helmet  mounting 

The  mounting  of  the  helmet  display  along  the  right  hand  side  of  the  helmet  gave 
rise  to  an  asymmetric  weight  problem,  Although  the  unit  was  fitted  just  below  the  head 
aentre  of  gravity  to  reduce  its  effective  moment,  it  still  tended  to  roll  the  pilot 'b 
head  to  the  right.  The  compensatory  muscle  power  needed  to  hold  the  head  upright  pro¬ 
duced  slight  neck  ache  in  some  pilots  after  an  hour's  sortie.  In  a  separate  experiment 
it  was  found  that  compensating  weights  on  the  left  side  of  the  helmet  improved  wearing 
comfort  considerably,  without  increasing  total  head  inertia  to  the  point  where  rapid 
azimuth  movements  became  difficult.  Another  problem  which  affected  performance  was 
cable  drag.  Apart  from  the  normal  earphone  and  throat  microphone  cable,  the  head  sight¬ 
ing  and  helmet  display  drive  cables  ran  from  the-  back  of  the  helmet  to  their  respective 
drive  eleotronics,  To  prevent  any  significant  restriction  on  normal  head  movements,  the 
cable  weight  was  fully  supported  by  rubber  straps  fixed  to  the  cabin  roof,  Operationally 
this  may  be  feasible,  provided  the  design  includes  a  provision  for  rapid  release  in  an 
emergency  situation, 
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7.5  Ease  of  UBe 

In  order  to  minimise  the  weight  of  the  helmet  display,  the  size  of  the  display 
objective  lens,  intermediate  lenseB  and  combiner  glass  were  kept  as  small  as  possible 
consistent  with  the  40°  field  of  view  requirement.  It  was  found  in  practice,  however, 
that  the  very  small  image  exit  pupil  and  eye  relief  that  the  design  philosophy  produced, 
made  it  very  difficult  to  adjust  the  display  on  the  helmet,  for  particular  subject 
pilots,  to  achieve  the  full  field  of  view  without  vignetting.  This  posed  particular 
problems  for  the  subject  pilots  who  wore  glasses,  most  of  whom  were  unable  to  establish 
a  satisfactory  adjustment.  The  criticality  of  this  optioal  design  would  obviously 
cause  serious  problems  when  t'ne  helmet  display  was  used  with  any  form  of  ohemical  or 
biological  defence  mask,  or  under  normal  helicopter  vibration  conditions.  It  should  be 
stated  that  the  unit  tested  was  early  generation  equipment,  and  that  mors  recent  displays 
have  a  larger  exit  pupil  and  eye  relief.  Nonetheless,  to  achieve  a  totally  acceptable, 
solution  requires  an  optioal  design  where  the  element  nearest  the  eye  has  some  optioal 
power.  One  way  of  achieving  this  is  to  use  the  helmet  visor,  as  this  optical  element 
acting  as  a  holographic  lens. 

7.6  Binocular  rivalry 

Helmet  sighting  systems  which  inject  weapon  or  flight  data  into  the  right  eye  have 
been  in  use  for  some  considerable  time  with  great  success.  In  this  case,  both  eyeB  oan 
see  the  outside  world  and  because  the  disparate  flight  data  into  the  right  eye  is  a 
relatively  small  proportion  of  the  total  field  of  view  and  consists  of  low  Bpatial  fre¬ 
quency  information,  the  brain  accepts  this  without  difficulty.  This  is  not  the  case  for 
the  visually  coupled  system,  however,  where  totally  disparate  information  is  fed  to  the 
foveal  areas  of  each  eye.  This  situation  gives  rise  to  a  physiological  effect  called 
binocular  rivalry  which  proved  to  be  the  most  significant  problem  found  during  the  simu¬ 
lator  trial.  In  normal  operational  flying  the  pilot  would  be  expected  to  view  the  image 
of  the  outside  world  with  the  right  eye  and  then  switch  hi3  mental  attention  to  the  left 
eye,  when  anything  needed  to  be  monitored  in  the  cockpit.  In  the  simulator,  the  cockpit 
was  darkened  to  simulate  night  conditions  and  the  display  set  to  oomfortable  viewing 
brightness  of  2  to  3  ft  lamberts.  After  a  certain  period  (whioh  varied  greatly  from  a 
few  minutes  to  half  an  hour,  depending  on  the  subject),  the  pilot  found  it  more  and  more 
difficult  to  concentrate  on  the  outside  world  as  the  scene  in  the  left  eye  would  keep 
breaking  into  his  attention.  The  only  way  to  stop  this  effect,  once  started,  was  for 
the  pilot  to  shut  his  left  eye.  By  experimentation,  it  was  found  that  equalising  the 
light  level  into  each  eye  caused  the  rivalry  problem  to  occur  fairly  soon  after  the  start 
of  the  flight  and  the  pilot  would  be  constantly  distracted  by  the  left  eye  soene  resulting 
in  severe  pilot  fatigue  after  a  half  hour  sortie.  If  the  light  level  into  the  left  eye 
was  reduced  to  a  minimum  by  using  a  darkened  visor  with  a  patch  over  the  foveal  region, 
.this  increased  the  time  to  the  onset  of  the  rivalry  problem,  but  then  when  it  did  occur 
.it  was  more  dramatic,  causing  the  outside  worLd  information  into  the  right  eye  to  he  lost 
temporarily,  Operationally,  at  low  level  by  night  this  could  be  disastrous. 

It  was  concluded  overall  from  the  experiment,  that  the  visually  coupled  system  was 
viable  provided  that  a  bi-oaular  or  binocular  viewing  system  could  be  developed  to 
overoome  this  rivalry  problem. 

The  Cooper  Harper  ratings  (Fig  6)  applied  to  the  system  acceptability,  ranged  from 
a  figure  of  6  (Bystem  has  very  objectionable  but  tolerable  deficiencies)  up  to  8  (system 
has  major  deficiencies).  In  terms  of  demands  on  the  pilot  thin  meant  at  beBt  that 
adequate  performance  requires  extensive  pilot  compensation,  to  at  worse  considerable 
pilot  compensation  is  required  to  retain  control.  When  commenting  on  these  figures,  the 
pilots  felt  that  they  could  be  halved  po  3  or  t  if  a  binocular  viewing  system  was 
developed,  and  a  higher  level  of  stabilisation  was  incorporated  into  the  simulated 
vehicle,  to  minimise  aircraft  handling  difficulties  when  looking  off-track. 

8  CONCLUSIONS 

The  results  of  the  trials  on  the  visually  coupled  system  described  in  this  paper 
have  adequately  demonstrated  the  viability  of  using  an  unsophisticated,  relatively  low 
cost  flight  simulator,  without  representative  motion  or  feel  charae  eristics  to  determine 
the  limitations  and  physiological  and  psychological  problems  of  a  complex  avionics  system. 
Further,  the  simulator  trials  have  demonstrated  the  advantages  of  the  visually  coupled 
system  and  established  the  desirable  system  performance  and  human  factors  interface  with 
the  pilot. 

It  is  believed  that  a  simulation  medium  of  this  nature,  where  the  system  could  be 
dynamically  teBted  albeit  crudely,  revealed  a  wealth  of  information  which  could  not  have 
been  established  other  than  by  way  of  extensive  flight  trials.  In  addition,  the  simula¬ 
tion  allowed  a  large  number  of  Bubjoct  pilots  to  be  exposed  to  the  system,  which  is  net 
usually  the  case  with  flight  trials,  where  pilot  participation  is  restricted  due  to 
specialist  nature  of  the  experimental  vehicle  and  system,  and  the  prohibitive  cost  of 
flying  hours  required  to  give  each  participant  adequate  exposure  t,o  tho  system. 

Finally,  since  the  simulator  assessment  provided  an  outline  specification  for  the 
most  expensive  airborne  piece  of  equipment  viz  the  sensor  platform,  it  provided  an 
essential  link  in  the  system  development  from  the  design  stage  to  flight  trials,  which  if 
omitted  could  result  at  best  in  gross  over  or  under  engineering  in  this  area,  and  at 
worse  in  major  design  faults  being  included  which  oould  prevent  any  useful  results  being 
obtained.  In  terms  of  coat  saving,  these  factors  alone  Justify  the  whole  of  the  interim 
ground  assessment . 


Turning  to  the  results  obtained  in  this  present  assessment,  it  is  believed  that  the 
trials  have  demonstrated  the  feasibility  of  the  visually  coupled  system  for  piloting  a 
helicopter  at  low  level  by  night.  It  is  concluded  that  fcne  main  advantage  of  the  system 
is  that  it  provides  the  pilot  with  a  complete  look  round  capability,  where  the  area  of 
coverage  is  dictated  solely  by  the  platform  degrees  of  freedom.  Particular  conclusions 
on  the  present  performance  are  as  follows 

(a)  to  maintain  pilot  orientation  the  platform  head  following  lag  must  be  mini¬ 
mised,  and  in  addition  cockpit  boresighted  overlay  flight  information  presented 
on  the  helmet  display  image; 

(b)  ''h®  optical  design  should  be  improved  to  provide  much  greater  display  image 
eye  relief  and  exit  pupil,  to  cater  for  pilots  with  glasses  and  other  forms  of 
head  protection  gear.  In  addition,  the  asymmetric  weight  problem  caused  by 
the  helmet  display  on  the  helmet,  should  be  overcome  by  balance  weightB 
initially  and  in  the  long  term  by  redesigning  the  unit  to  give  a  better  weight 
distribution; 

(o)  the  present  monocular  system  gives  rise  to  binocular  rivalry  which  could  pro¬ 
duce  serious  flight  safety  problems  when  operating  at  low  level.  The  develop¬ 
ment  of  a  binocular  or  bi-oeular  viewing  system  is  therefore  essential  if  the 
visually  coupled  system  is  to  be  operationally  viable; 

(d)  the  basic  aircraft  handling  qualities  required  to  provide  an  acceptable  task 
level  for  the  pilot  when  flying  on  the  helmet  display  should  be  such  that 
pilot  compensation  io  not  a  factor  in  achieving  desired  performance.  In 
practical  terms,  this  would  mean  at  least  a  low  authority  attitude  stabilisa¬ 
tion  system  in  the  pitch  and  roll  axes. 
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Fig  3  Map  cf  belt  terrain  showing  the  waypoints  and  route  for 
the  navigation  task 


Overlay  flight  information  shown  against  the  outside  world 
picture  from  the  model  terrain 


Fig  7  Terrain  map  showing  the  positions  of  simulated  tanks 
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SUMMARY 

An  evaluation  program  hat  been  initiated  in  the  U.S,  Department  of  Defense,  Test  and  Evaluation  (DDTE)  to  ataesa  the 
ability  of  the  Indirect  subiyatem  on  the  evolving  NATO  Identification  System  (NIS)  to  support  the  identification  requirements 
of  selected  air  defense  weapon  systems.  It  is  projected  that  the  evaluation  program  will  consist  of  two  phases;  1)  a  simulation 
phase,  which  will  employ  a  testbed  consisting  of  operational  units  and  manned  simulators  driven  by  a  central  simulation  facility; 
and  2)  a  limited  field  test  phase,  taking  advantage  of  programmed  field  test  exercises  to  validate  the  simulation  phase,  where 
possible,  and  enhance  program  credibility.  This  paper  describes  the  architecture  for  the  proposed  simulation  testbed  and 
illustrates  its  potential  utilization  in  evaluating  the  performance  of  a  NATO  Airborne  Early  Warning  aircraft  In  support  of 
defensive  counterair  operations. 


INTRODUCTION 

It  is  widely  recognized  in  the  tactical  community  that  t.ie  inability  of  key  users  to  discriminate 
accurately  and  rapidly  between  friendly,  hostile,  and  neutral  aircraft  may  significantly  limit  the  effec¬ 
tive  utilization  of  air  defense  weapon  systems.  This' recognition  hat  stimulated  activity  within  NATO  to 
develop  an  effective  NATO  Identification  Systam  (NIS).  This  evolving  system  consists  of  two  complemen¬ 
tary  subsystems  (Figure  1);  (1)  a  Direct  Subayatem  (DOS),  which  provides  an  autonomous  identification 

capability  for  individual  users,  the  primary  element  of  which  is  a  question-and-anawer  component;  end  (2) 
an  Indirect  Subsystem  (ISS),  which  formulates  identification  decisions,  procedures,  and  guidance,  and 
disseminates  them  to  selected  user*  to  verify  the  correctness  of  their  decisions  and  enhance  their  con¬ 
fidence  in  the  deciiion-making  process.  The  ISS  is  largely  embedded  in  the  commend  and  control  (C2) 
system  that  is  dedicated  to  air  operations. 

The  U.S.  Department  of  Defense,  Teet  and  Hva.  uat  sn  (DDTB) ,  is  embarking  upon  a  multiyear  program  to 
evaluate  the  ability  of  the  ISS  to  support  the  i  intification  process  in  an  operational  environment,  A 
Joint  Test  Force  (JTF)  is  being  assembled  to  conduct  the  progrtm  with  executive  direction  vested  in  the 
U.S.  Air  Force.  This  paper  describes  that  program,  emphasizing  the  role  that  modeling  and  simulation 
will  play  in  the  evaluation.  The  next  eectlon  on  Nature  of  the  Identification  Process  places  the  identi¬ 
fication  process  in  perspective,  focusing  on  the  relationship  of  the  C2  syBtem  and  selected  weapon 
systems  in  the  context  of  the  NATO  environment.  This  p*cvido»  the  basis  for  tho  IFFN  Evaluation  Program, 
whose  objectives  and  structure  are  delineated  in  the  next  section,  Programmatic  Features.  Here  are 
specified  the  types  of  tests  that  are  to  be  employed  t>  accomplish  the  program  objectives.  The  remainder 
of  the  paper  is  restricted  to  a  discussion  of  tho  primary  test  vehicle;  a  hybrid,  geographically  distrib¬ 
uted  testbed  consisting  of  a  central  simulation  facility,  manned  operational  C2  systems,  and  manned 
mission  simulators.  The  loathed  Haquiromente  section  summarizes  the  technical  requirements  for  the  test¬ 
bed  and  examines  the  considerations  underlying  their  formulation.  This  has  given  riae  to  a  preliminary 
architecture  for  the  identification  testbed  which  is  described  under  tho  next  heading,  Identification 
Testbed  Architecture.  To  illustrate  the  potential  utilization  of  tho  testbed,  the  Illustrative  Test  Deaigt 
section  presents  an  example  of  a  test  design  that  considers  the  subphase  of  the  program  where  a  programmed 
NATO  Airborne  Early  Warning  (NAEN)  aircraft  is  employed  in  support  of  defensive  countexair  (DCA)  opera¬ 
tions,  The  Conclusions  portion  summarizes  the  major  features  of  the  evaluation  program. 

NATURE  OF  THE  IDENTIFICATION  PROCESS 

LIMITATIONS  OF  TUB  DIRECT  SUbS.'STEM 

It  is  well  recognized  that  a  reliable,  accurate,  and  responsive  DSS  is  u  necessary  component  in  the 
ovolving  NIS,  However,  it  Is  not  in  itself  sufficient  to  support  all  of  the  requirement*  for  users  of 
identification  Information.  This  conclusion  follows  from  the  fact  that,  for  densely  distributed  air  . 
defense  aystems  that  rely  on  an  autonomous  DSS  to  identify  targets  independently,  the  probability  is  high 
that  an  overflying  friendly  aircraft  will  be  exposed  to  at  least  one  system  that  will  err  in  identifica¬ 
tion.  As  an  illustration,  consider  the  groundbased  air  defense  units  (ADUs)  deployed  in  the  forward 
division  area  (e.g,,  short-range  air  defense  systems  (SHORADS) ,  low-altitude-missile  air  defenee  systemi 
(LOMADS)).  There  would  be  In  excess  of  a  hundred  of  these  systems  for  a  representative  division.  If 
these  weapon  systoms  were  deployed  uniformly,  even  low-altitude  aircraft  traversing  the  division  area  would 
be  exposed  to  many  (e.g,,  an  average  of  10  or  more)  ADUs.  Under  the  highly  optimistic  aesumption  that  each 
ADU  operator  correctly  identifies  aircraft  with  probability  0.95,  if  10  weapon  systems  were  overflown,  at 
least  one  of  the  operators  would  mis identify  the  aircraft  with  probability  0.40  (Figure  2),  The  fratrici¬ 
dal  implication  of  this  misidentlfication  would  depend  on  the  prevailing  rules  of  engagement  (ROBs) , 
weapon  system  performance,  and  target  dynamics.  It  is  left  to  the  ISS  to  ameliorate  thi*  fundamental 
deficiency  by  disseminating  identification  information,  airspace  control  procedures,  and  guidance  to  those 
weapon  system  operators. 

C2  WEAPON  SYSTEM  RELATIONSHIP  IN  THE  IFFN  PROCESS 

If  an  air  defense  weapon  system  is  to  be  employed  effectively,  the  operator  must  detect  a  target, 
identify  it,  and  then  make  an  appropriate  engagement  decision.  The  C2  system  should  play  an  important 
role  in  influencing  the  ability  of  the  weapon  system  operator  to  perform  eech  of  these  functions  (Figure 
J). 


•  Detection.  The  C2  system  can  Influence  the  ability  of  a  weapon  system  operator  to  detect  a 
target  in  progressively  more  detailed  ways;  (1)  promulgation  of  advanced  states  of  alert  (e.g., 
placing  all  forces  on  advanced  states  of  alert  to  warn  of  an  Impending  raid);  (2)  tactical  alert 
(e,g,,  warning  specific  weapon  systems  operators  of  approaching  aircraft);  and  (3)  cueing  (e.g., 
passing  relative  range  and  atimuth  of  a  specific  target,  or  set  of  targets  to  a  weapon  systems 
operator).  These  Inputs,  in  conjunction  with  the  organic  detection  capabilities  of  the  weapon 
system  operator,  determine  the  probability  that  the  operator  detects  a  given  target  and  the 
temporal  and  spatial  conditions  under  which  detection  occurs, 

e  Identification,  Once  the  weapon  system  operator  has  detected  a  target,  the  C2  system  can  contrib¬ 
ute  to  the  identification  process  through  the  following  mechanisms:  (1)  issuance  of  hostile  act 
criteria  (e.g.,  defining  a  behavior  profile  of  a  hostile  intruder  that  tha  weapon  system  operator 
can  use  as  a  basis  for  evaluating  his  observations);  (2)  promulgation  of  airspace  control  proce¬ 
dures  (s.g.,  defining  a  behavior  profile  of  friendly  aircraft  by  establishing  a  bound  on  speed 
and  restricting  allowable  spatial  corridors  ot  altitudes);  end  (3)  Indirect  IFFN  information 
(e.g,,  passing  the  C2  system  identi Tication  decisions  to  the  weapon  system  operator),  The  weapon 
system  operator  must  synthesize  this  information  with  hii  direct  sources  of  identification  data 
to  arrive  at  an  IPFN  decision.  Once  he  has  reached  this  decision,  the  woapon  system  operator 
might  transmit  the  result  back  to  the  C2  system  as  indirect  1FPN  information. 

a  Engagement,  The  actions  of  the  weapon  system  operator  are  influenced  by  the  result  of  the  Identi¬ 
fication  process,  inputs  from  he  C2  system,  and  the  capabilities  (or  perceived  capabilities)  of 
the  weapon,  The  interaction  between  the  identification  decision  and  guidance  afforded  by  the  C2 
system  is  reflected  In  tho  RORs  under  which  the  operator  must  function. 

As  a  consequence  of  this  confluence  of  factors,  the  weapon  system  operator  may  perform  one  of  the 
following  actions  (Figure  4); 

-  Valid  action:  (1)  Engage  and  destroy  an  enemy  with  probability  of  kill  P^,  depending  on  weapon 
capabilities,  enemy  countermeasures,  and  the  dynamics  of  the  encounter;  or  (2)  not  engage  a 
friendly  or  neutral  aircraft, 

-  Degraded  action;  Suffer  reduced  effectiveness  in  engaging  enemy  targets  because  of  time  delays 
(arising  from  detection,  weapon  setup  time,  identification,  or  coordination  with  the  C2  system 
and  other  weapon  system  operators)  or  maldistribution  of  fire,  This  action  may  still  contrib¬ 
ute  to  the  air  defense  process  if  the  engagement  causes  the  hostile  aircraft  to  be  leaa  effec¬ 
tive  in  performing  hla  mission  (i.e,,  "virtual  attrition"). 

-  Invalid  action;  (1)  Engage  a  friendly  or  neutral  target  and  (a)  commit  fratricide  with  proba¬ 
bility  of  kill  Pv  or  (b)  fail  to  deBtroy  the  target,  but  degrade  confidence  in  the  system  and 
waste  ordnance;  (2)  fail  to  engage  a  hostile  target,  even  when  engagement  is  authorized  under 
the  prevailing  ROBs. 

Theso  observations  reveal  that  the  IPFN  process  is  imbedded  in  the  broader  engagement  process  tnd  is 
inextricably  linked  with  the  C2  system.  Hence,  the  IFFN  evaluation  program  will  assess  the  impact  of  the 
identification  process  on  the  capabilities  of  a  weapon  system  in  the  context  of  the  associated  C2  system. 
Although  this  is  an  undertaking  of  exceptional  breadth,  it  has  barn  extended  still  one  step  further; 
since  the  identification  process  is  inherently  a  two-sided  process,  encompassing  attampts  of  opponents  to 
deceive,  exploit,  Jam,  or  destroy  key  elements,  the  systems  and  procedures  of  both  projected  combatants 
are  included  as  integral  components  of  the  evaluation  program, 

DISTINCTIVE  ASPECTS  OF  THE  CENTRAL  BUROPBAN  THEATER 

The  central  Buropoan  theater  is  of  extreme  intoreat  to  policy  plannori  in  the  United  States  and  consti¬ 
tutes  a  bounding  case  for  many  of  tho  parameters  of  interest  (e.g.,  numbers  and  densities  of  aircraft  and 
BCM) .  It  is  perceived  by  many  that  solutions  which  are  proven  effective  in  NATO  will  prove  adequate  in 
less  demanding  environments. 

Accordingly,  the  IPFN  evaluation  program  is  placing  emphasis  on  analyzing  the  identification  pTOcasa 
in  the  context  of  a  projected  conventional  conflict  in  central  Europe.  The  major  factors  in  thut  region 
that  are  being  considered  in  the  evaluation  program  are  summarized  below, 

e  Threat  Conditione.  In  a  projected  conflict  in  the  NATO  Central  Region,  in  excoss  of  a  thousand 
aircraft  could  be  airborne,  simultaneously,  at  altitudes  ranging  from  ton*  of  meter*  to  tens  of 
kilometers.  Since  much  of  this  air  traffic  would  fly  in  formations,  even  radar  sensors  with  an 
extended  visw  of  the  battle  area  (e.g,,  NAEW  aircraft)  would  probably  perceive  no  more  than 
several  hundred  radar  tracks,  The  performance  of  most  sensor  and  avionics  equipment  will  prob¬ 
ably  be  degraded  by  extensive  employment  of  chaff  and  jammers  carried  by  standoff  and  escort 
aircraft. 

e  Ambient  Conditions,  The  proliferation  of  many  electronic  system*  that  are  potentially  self¬ 
jamming  (e.g.,  Mark  X]  suggests  that  electromagnetic  interference  may  significantly  degrade 
the  performance  of  key  systems  in  the  NATO  Central  Region.1  These  problems  may  be  worsened  by 
poor  visibility  and  terrain  shielding,  which  are  characteristics  of  the  meteorology  and  the 
topography  of  the  rogion  (e.g.,  low-altitude  clouds  and  fog  and  intermittent  masking  of  low- 
altitude  targets  to  ground-based  sensors). 

#  HonhomogeneouB  Allied  Aircraft  Mix.  There  is  a  broad  mix  of  Atlied  aircraft  types  and  avionics 
gear  that  compounds  the  problems  of  both  visual  and  electronic  identification. 


'This  is  exacerbated  by  the  fact  that  many  of  the  modes  employed  by  Mark  X  are  incorporated  in  the  Air 
Traffic  Control  Radar  Beacon  System  (ATCRBS)  which  supports  civilian  air  traffic  control. 


•  £7*  Structure.  The  C2  system  associated  with  air  defense  in  NATO  is  a  unique,  complex  combination 
of  NATO  facilities  (e.g.,  the  control  and  reporting  centers  of  the  412L  system  in  the  southern 
region  of  t.he  Federal  Republic  of  Germany)  and  nation»l  systems  (e.g,,  the  ll.S.  Air  Force's  Air 
Control  and  Warning  (AC$W)  component  of  its  Tactical  Air  Control  System  (TAGS);  the  U.S.  Army's 
TSQ-73  Missile  Minder,  for  the  control  of  Improved  Hawk  and  Nike-Hercules) . 

The  evaluation  program  is  further  complicated  by  the  fact  that  the  identification  process  is  evolving 
in  time  as  a  consequence  of  programmed  and  planned  changes  in  several  areas: 

e  Deployment  of  new  weapons  with  longer  range  and  enhanced  lethality  (e.g,,  Patriot,  a  surface-to- 
air  missile  system  designed  around  a  phased  array  radar;  the  advanced  Medium-Range  Air-to-Air 
missile  to  replace  Sparrow) , 

e  New  and  updated  C2  systems  and  procedures  (e.g,,  the  programmed  deployment  of  the  NABW  system, 
the  generation  of  a  modified  NATO  Central  Region  Airspace  Control  Plan), 

Accordingly,  the  evaluation  program  will  establish  baselines  of  performance  where  that  information  it  per¬ 
ceived  to  be  edifying,  and  conduct  exploratory  evaluations  of  selected  programmed  and  proposed  equipment, 
procedures,  and  doctrine, 


PROGRAMMATIC  FEATURES 

This  section  Identifies  the  objectives  of  the  1FFN  program  and  the  approach  that  is  to  be  employed  to 
realise  these  objectives.  It  recounts  prior  relevant  simulation  activities  and  the  lessons  that  have  boen 
derived  from  those  programs, 

OBJECTIVES 

The  major  objective  of  the  IPFN  Evaluation  Program  is  to  assess  the  ability  of  the  ISS  to  support  the 
identification  needs  of  tactical  airoraft  operators  and  high-altitude  missile  air  defense  system  (HIMADS) 
operators  in  an  operational  environment.  For  the  purposes  of  this  paper,  the  ISS  it  viewod  at  the  equip¬ 
ment  (e,g,,  sensors,  computers,  displays,  communications)  and  personnel  at  key  nodes  of  the  C2  system 
that  supports  air  defense  operations, 

The  key  C2  systems  of  interest  for  the  control  of  tactical  aircraft  and  HIMADS  are  depicted  in  Figure 
5  for  the  Pourth  Allied  Tactical  Air  Forces  (4ATAF)  region1  of  NATO  in  a  mid-1980s  time  frame.  The  major 
components  of  the  ISS  include: 

e  Control  and  Reporting  Centers  (CRCa)  of  the  German  Air  Defense  Ground  Environment  (GEADGE). 

These  fixed,  bunkered  systems  will  constitute  the  4ATAF  component  of  the  NATO  Air  Defense  Ground 
Environment  (NADGE) .  The  identification  officers  (IDOs)  in  these  facilities  are  the  focal 
points  of  the  ISS, 

e  Control  and  Reporting  Ponte  (CliPe)  of  tha  V.S.  Air  Foroe'e  4B6L  System,  These  transportable  facil¬ 
ities  will  be  able  to  exchange  digital  data  with  GEADGB  through  the  Message  Processing  Contor 
(MPC) ,  Assistance  in  the  identification  process  may  be  forthcoming  from  its  Movements  and  Identi¬ 
fication  (MQI)  section, 

e  NATO  Airborne  Early  Naming  (NAEW)  Aircraft.  These  aircraft  will  augment  the  sir  picture  of  the 
ground-based  C2  systems  and  havo  the  potential  to  support  limited  control  functions  if  selected 
ground-based  facilities  aro  inoporative  or  saturated, 

a  Group  and  Battalion  Operations  Centers  (GOCs  and  BOCs)  Employing  the  U.S.  Amy '»  TSQ~7S.  These 
transportable  facilities  are  equipped  with  two  displays  to  support  tho  C2  of  HIMADS  batteries. 

The  group  lovel  Is  primarily  charged  with  coordinating  and  managing  the  air  picture  while  the 
battalion  manages  the  local  air  picture  and  allocates  and  monitors  fire  unit  performance. 

In  order  for  the  controllers  in  these  facilities  to  assist  weapon  system  operators  in  the  identifica¬ 
tion  process,  they  must  be  able  to  perform  a  sequence  of  functions:  (1)  detect  and  track  targets;  (2) 
correlate  identification  information  with  these  tracks  and  aynthesiie  it  into  a  correct,  timely  identifi¬ 
cation  docision;  and  (3)  disseminate  these  identification  decisions  to  weapon  system  operators  and  validate 
the  woapon  system's  association  of  that  data  with  the  correct  targets. 

To  realize  this  objective  will  require  the  evaluation  of  two  levels  of  figures  of  merit.  Ai  an  inter¬ 
mediate  level,  data  will  have  to  be  acquired  under  operationally  realistic  conditions  to  characterise  the 
detection  and  identification  performance  for  selected  controllers  and  weapon  systems  operators.  This  will 
include: 

a  Deteation;  Temporal  end  spatial  conditions  when  detection  occurs. 

•  Identification: 

-  for  those  targets  that  are  detected,  the  percentage  that  are  identified 

-  for  those  targets  that  are  identified,  the  percentage  that  are  correctly  identified 

-  the  temporal  and  spatial  conditions  when  identification  occuts, 


^is  region  includes  the  southern  sector  of  the  Federal  Republic  of  Germany  (FRG)  . 
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As  an  overall  figure  of  merit,  it  is  necessary  to  relate  identification  performance  to  weapon  system 
effectiveness.  This  will  be  characterised  by  computing  the'likelihood  of  each  event  depicted  on  the  tree 
in  Figure  4  for  specified  environmental  conditions. 

The  initial  assessments  will  establish  a  quantitative  baseline  of  performance  against  which  proposed 
improvements  to  the  identification  process  can  be  measured.  Emphasis  will  be  placed  on  determining  the 
conditions  (e.g.,  aircraft  numbers,  BCM  levels)  where  the  ability  of  a  controller  to  perform  the  aubfunc- 
tions  in  the  identification  process  degrades  appreciably, 

Subsequent  assessments  will  determine  the  potential  improvements  in  1SS  performance  that  are  achievable 
through  several  different  levels  of  development. 

e  "Black  Bote"  Improvements.  Upgrading  or  developing  new  sources  of  identification  information  (e.g., 
developing  a  new  quest ion-and-answer  system  to  replace  Mark  X/XII) . 

e  Subsystem  Enhancements.  Improving  the  automated  data  processing  equipment  that  supporta  C2  control¬ 
lers,  One  important  subissue  is  the  evaluation  of  the  effectiveness  of  fusion  algorithms  that 
have  been  proposed  to  facilitate  the  synthesis  of  identification  information  into  a  decision. 

e  System  Modifications.  Enhancing  the  interoperability  of  tactical  data  systems  (i.e,,  enabling 
them  to  exchange  digital  track  data  in  real  time) ,  Although  this  capability  hat  been  demonstrated, 
no  attempt  has  been  made  to  quantify  its  impact  on  identification  performance  or  weapon  system 
effectiveness,  Assessments  are  also  required  of  the  impact  of  proposed  changes  to  the  airspace 
control  procedures  in  the  NATO  Central  Region. 

Since  the  evaluation  program  will  require  either  operational  units  or  prototype  systems  to  carry  out 
the  assessment,  the  program  will  be  limited  to  systems  and  procedures  that  could  be  operationally  employed 
in  an  early  19S0s  time  frame. 

STRUCTURE 

In  order  to  realise  these  objectives,  it  will  be  necessary  to  Identify  appropriate  test  vehicles. 

These  potential  vehicles  fall  into  two  broad  classes:  simulation  and  field  tests.  If  the  vehicle  it  to 
serve  the  needs  of  the  program,  it  must  be  capable  of  incorporating  the  distinctive  aspects  of  the  identi¬ 
fication  process  that  were  described  in  the  Naturs  of  tfte  Identification  Process  section.  In  addition  to 
these  attributes  of  operational  fidelity,  consideration  must  be  given  to  such  factors  as  constraints  im¬ 
posed  by  safety  and  resource  availability,  controllability  of  test  conditions,  data  collection  problems, 
and  cost.  After  these  factors  ware  considered,  a  program  was  fashioned  that  focused  on  the  creation  of  a 
simulation  testbed  consisting  of  operational  units,  manned  simulators,  and  computer  emulations.  In  view 
of  the  complexity  of  the  total  syatem  of  interest,  an  essential  element  of  the  program  was  to  define  a 
sequence  of  subphases  that  progressively  considered  increased  level  of  C2  system  integration  and  complexity, 
This  progression  is  described  under  the  next  heading,  Tostbed  Requirements. 

To  enhance  the  credibility  of  these  simulation  results,  it  is  deemed  desirable  to  validate  the  perfor¬ 
mance  observed  in  the  simulation  testbed  for  limited  conditions  that  can  be  reproduced  using  live  aircraft 
and  the  operational  C2  system.  However,  since  it  is  not  feasible  to  reproduce  realistic  operational  condi¬ 
tions  in  peacetime  (e.g.,  limitations  on  aircraft  numbers,  trajectories,  and  BCM),  a  complete  validation 
of  the  simulation  results  cannot  be  performed  using  field  exercises  or  a  dedicated  field  test.  Instead  a 
limited  validation  will  be  sought  by  demonstrating  that  the  results  from  the  field  exercises  are  reproduc¬ 
ible  in  the  testbed.  An  assessment  of  ongoing  exercise  series  is  currently  in  process  to  determine  which, 
if  any,  field  exercise  could  be  employed  to  support  this  limited  validation  process. 

RELEVANT  SIMULATION  BXPBKIENCB 

The  decision  to  employ  a  simulation  testbed  as  the  primary  evaluation  tool  is  based,  to  a  considerable 
degree,  on  the  experiences  of  the  tactical  sir  control  system/tactical  air  defense  system  (TACS/TADS) 
interoperability  program.  The  purpose  of  that  program  was  to  test  and  certify  the  technical  compatibility 
and  interoperability  of  U.S,  TACS/TADS  systems  in  joint  military  operations.  Participating  systems  were 
selected  from  the  four  U.S.  Services  which  manifested  the  following  characteristics:  (1)  mobile,  (2)  auto¬ 
mated  or  semiautomated,  (3)  deployed  worldwide,  and  (4)  users  of  selected  tactical  digital  communications 
links.1  Some  examples  of  these  systems  are  (1)  components  of  the  ACQW  subsystems  of  the  U.S.  Air  Force's 
TAGS,  (2)  the  Army's  TSQ-75,  (S)  the  Navy's  Naval  Tactical  Data  System  (NTDS)  and  Airborne  Tactical  Data 
System  (ATDS)  end  the  Marine  Corps'  Marine  Tactical  Data  System  (MTDS) . 

In  order  to  realise  their  objectives,  a  distributed  testbed  was  assembled  consisting  of  the  actual 
participating  data  systems  under  the  control  of  a  central  simulation  and  monitoring  facility.  The  current 
mission  of  the  testbed  is  to  support  configuration  management  activities.  In  October  I960,  this  configura¬ 
tion  management  task  is  to  be  transferred  to  the  Joint  Interoperability  for  Tactical  Command  and  Control 
System  (JINTACCS)  program.  JINTACC8  is  to  expand  the  scope  of  the  TACS/TADS  program  by  testing  and  certify¬ 
ing  the  Interoperability  of  tactical  data  systems  that  support  intelligence,  fire  support,  amphibious 
operations,  operations  control,  and  air  operations. 

The  TACS/TADS  testbed  established  the  feasibility  of  creating  a  geographically  distributed  facility 
consisting  of  operational  C2  systems  linked  via  leased  lines,  It  also  demonstrated  the  feasibility  and 
flexibility  of  the  centralitod  control  concept,  which  employs  a  Central  Simulation  Facility  (CSF)  as  the 
focal  point  of  all  test  activities  (i.e.,  generates  all  stimuli,  coordinates  and  monitors  the  testing). 

This  concept  is  proposed  for  the  IFFN  testbed  also,  although  other  approaches  are  still  under  consideration. 

The  TACS/TADS  testbed,  while  providing  a  firm  basis  for  the  IFFN  evaluation,  had  a  differant  orienta¬ 
tion  to  its  purpose  and  scope.  The  IFFN  testbed  requires  significant  extensions  in  the  following  areas: 

^Tactical  Digital  Intelligence  Links  (TAP1LS)  A  and  B,  which  provide  roll-call  and  point-to-point  communi¬ 
cations,  respectively. 


•  Paptiaipa'inp  C2  System:  To  assess  the  ISS  of  the  NIS,  it  is  necessary  to  incorporate  surrogates 
for  selected  NATO  and  Warsaw  Pact  C2  systems. 

•  Partiaipating  Weapon  Systems:  Simulated  tactical  aircraft  and  SAM  weapon  systems  are  to  be  incor¬ 
porated  to  evaluate  the  interface  between  the  C2  system  controller  and  the  weapon  system  operator. 

a  Evaluation:  The  TACS/TADS  program  was  primarily  interested  in  monitoring  and  ensuring  the  fidelity 
of  digital  data  transfer  among  participating  units.  The  IFFN  Evaluation  Program  is  attempting  to 
establish  the  quantitative  benefits  that  can  be  derived  from  the  ISS  by  weapon  system  operators. 

The  remainder  of  this  paper  describes  how  these  objectives  will  be  accomplished  in  the  IFFN  evaluation 
testbed , 

TESTBED  REQUIREMENTS 

The  basis  for  the  simulation  testbed  is  established  through  the  formulation  of  a  set  of  system  require¬ 
ments  compatible  with  the  critical  issues  to  be  evaluated.  These  requirements  should  define  the  essential 
characteristics  of  the  testbed  without  unduly  constraining  the  design  realization.  This  section  of  the 
paper  articulates  these  requirements  and  examines  the  considerations  underlying  their  formulation  in  terms 
of  i 

e  Scope  of  the  simulation  (i.e.,  geographical  arena,  facilities  represented,  the  air  battle  scenario 
to  be  played) . 

e  Representation  methodology  and  realism  (i.e,,  fidelity  requirements,  methods  used  to  represent 
facilities,  sensors,  aircraft) . 

e  Provisions  for  test  control  and  assessment  (i.e,,  scenario  preparation,  stimulation,  monitoring, 
data  processing) . 

e  Realization  of  the  testbed  (i.e.,  modular  evolution,  flexibility). 

SCOPE 

The  nature  of  the  ISS  is  such  that  the  toatbed  must  simulate! 

a  A  significant  volume  of  the  central  Europe  airspace. 

e  Numerous  facilities  and  sensors  of  varioui  types. 

e  A  large  variety  of  air  operations. 

The  facilities  simulated  must  encompass  both  the  NATO  systems  and  the  opposing  Warsaw  Pact  systems,  More¬ 
over,  these  must  include  not  only  facilities  directly  executing  air  defense  operations  (see  Figure  5),  but 
also  any  air  defense  planning  facilities1  and  offensive  air  operations  facilities2  whose  actions  indirectly 
impact  the  identification  process.  Not  counting  interceptor  aircraft,  thore  are  almost  SO  individual  nodes 
that  must  be  represented.  These  compose  more  than  IS  typos  of  C2  centers  and  weapons  systems.  Supporting 
these  systems  are  an  array  of  over  100  individual  sensors  of  55  types,3  Howover,  it  is  not  necessary  to 
cover  this  entire  domain  at  a  uniformly  high  levol  of  detoil.  Accordingly,  it  has  boen  visualized  as  con¬ 
sisting  of  two  components! 

e  The  simulation  aove  -  comprising  the  facilities  and  airspace  of  primary  interest. 

e  The  simulation  baokgvound  -  comprising  peripheral  elements,  of  interest  only  because  of  their 
effects  on  the  core. 

The  simulation  coro  is  a  subregion  of  limited  extent.  It  constitutes  the  smallest  slice  of  the  systems 
and  airspace  necessary  to  include  all  primary  identification  interactions  and  thoir  consequent  operational 
impact.  This  slico  will  be  aligned  to  cover  a  particular  portion  of  the  forwurd  battle  aroa,  where  (1) 
Intense  air  activity  is  expected,  (2)  the  full  variety  of  generic  system  typos  are  employed;  and  (3)  the 
full  spectrum  of  identification  situations  is  anticipated,  The  focal  area  will  be  represented  to  a  high 
lovel  of  reallsm--using  live  unlts--and  will  bo  extensively  instrumented  to  obtain  the  required  measures 
of  performance, 

The  simulation  background  covers  a  much  wider  set  of  facilities  and  a  broader  airspace  area,  encompass¬ 
ing  the  entire  environment  surrounding  the  simulation  core,  It  is  required  because  actions  taken  within  it 
can  affect  events  in  the  simulation  core,4  However,  it  will  be  represented  at  a  lessor  level  of  realism. 

figuro  6  depicts  the  approximate  geography  of  the  airspace  corresponding  to  the  above-described  compo¬ 
nents,  with  the  core  shown  as  the  black  inner  region,  and  the  background  area  depicted  as  the  partially 
shaded  outer  area.  As  depicted,  the  total  area  to  be  covered  includes  a  subset  of  the  Central  Region  or 
NATO  centered  in  the  F-'HG  forward  area,  Tho  extension  beyond  the  political  borders  into  Warsaw  Pact  airspace 
accommodates  early  warning  systems  and  allows  for  the  play  of  the  Warsaw  Pact  systems. 

The  evaluation  issues  related  to  battle  intensity  and  system  loadings  require  that  the  testbed  be  capa¬ 
ble  of  supporting  a  high-intensity  air  battle  scenario,  This  would  correspond  to  the  air  activities 

'Por  example,  ATAF  Airspace  Control  Center  (AACC) ,  Air  Defense  Operations  Center  (ADOC) , 

2Por  examplo,  the  Air  Tactical  Operations  Center  (AYOC)  which  supports  the  tasking  of  offensive  operations. 
3-Somo  of  these  uro  of  similar  generic  type  and  include  existing  and  new  sensors, 

4Por  instance,  adjacent  air  defense  facilities  situated  in  the  background  area  may  provide  early  warning 
alerts  and  cueing  to  a  facility  in  the  core  area, 
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expected  during  the  early  phases  of  a  full-scale  conventional  Warsaw  Pact  attack.  The  full  variety  of 
Pact  and  NATO  aircraft,  encompassing  upwards  of  35  aircraft  types,  will  need  to  be  modeled.  These  will  be 
executing  the  full  range  of  offensive  and  defensive  missions  in  a  high-intensity  electronic  warfare  environ¬ 
ment.  This  scenario  also  Implies  that  the  testbed  should  have  sufficient  capacity  to  provide  simulated 
air  traffic  comprising  up  to  500  flights  in  formations  of  2  to  16  aircraft,  occurring  over  a  1-hour  time 
window.  v 

REPRESENTATION  OF  THE  AIR  BATTLE  ELBMBNTS 

For  the  identification  testbed  to  be  credible,  it  must  represent  each  element  of  the  air  battle  in  a 
sufficiently  realistic  manner,  A  variety  of  simulation  methods  of  varying  fidelity  are  available  which 
might  be  used.  In  each  case  the  choice  must  be  made  by  balancing  cost  and  feasibility  against  the  level 
of  fidelity  judged  to  be  necessary, 

The  term  fidaUty  refers  to  the  faithfulness  with  which  the  various  components  of  the  system  are  to  be 
represented.  The  fidelity  issue  is  very  important  to  the  credibility  and  eventual  acceptance  of  the  find¬ 
ings  of  the  evaluation  program.  While  achieving  high  fidelity  is  a  desirable  goal,  the  cost  of  doing  so 
can  be  quite  high.  Costs  accelerate  rapidly  as  ever-higher  levels  of  fidelity  are  approached,  particularly 
in  the  areas  of  hardware  and  software.  Moreover,  there  is  a  diminishing-returns  effect,  to  that  beyond  a 
certain  point  further  improvements  to  fidelity  have  a  rapidly  diminishing  influence  on  experimental  results. 
The  goal,  then,  is  to  establish  testbed  fidelity  requirements  that  exhibit  a  satisfactory  balance  between 
cost  and  fidelity.  It  is  difficult,  however,  to  determine  exactly  where  this  balance  point  lies,  To  do  so 
would  require  a  series  of  special  experiments  designed  to  compare  system  responses  for  emulations  having 
varying  fidelity  levels.  The  expense  of  doing  this  is  justifiable  only  for  certain  critical  emulated  ele¬ 
ments,  where  the  cost  impact  of  enhanced  fidelity  is  potentially  high.  In  other  less  critical  cases,  where 
the  cost  impact  is  low  or  the  emulated  elements  are  in  the  background  area,  the  approach  will  be  more  judg¬ 
mental,  relying  on  the  prior  experience  of  persons  doing  the  planning  and  Industry  estimates.  Also,  calib¬ 
ration  checks  on  the  fidelity  will  bo  built  into  the  test  design  and  accomplished  early  in  the  test  program. 

The  identification  testbed  will  be  a  hybrid  in  that  it  will  employ  a  combination  of  methods  to  repre¬ 
sent  the  full  array  of  systems  it  encompasses.  Figure  7  details  the  application  of  the  various  representa¬ 
tions  for  the  NATO  forces  portion  of  the  testbed.  The  methods  of  representation  can  be  classified  into  two 
general  categories:  live  participating  units  and  computer  models. 

The  tern:  live  partiaipating  unit  CLPUj  refers  to  the  mode  in  which  a  system  is  represented  by  having 
personnel  man  either  actual  operational  or  surrogate  equipment  for  that  system.  The  testbed  will  emphasize 
LPUs  as  the  primary  means  for  representing  the  air  defense  systems  within  the  simulation  core  that  are 
directly  involved  in  identification.  The  reason  for  this  is  that  computer  models,  though  economical  and 
easily  controlled,  become  unrealistic  for  man- in -the -loop  systems.  In  systems  of  this  type,  human  inter¬ 
actions  occur  for  which  relationships  between  stimuli  and  response  are  unknown.  This  situation  exists  at 
g  number  of  critical  points  in  the  ISS  of  the  identification  process,  For  example,  the  IDO  in  a  CRC  must 
interact  with  his  own  automated  devices  and  must  frequently  consult  with  other  persons  (e.g.,  other  IDOs, 
weapons  controllers,  air  traffic  controllers)  in  his  own  facility  and  in  other  facilities.  Weapon  eystem 
operators  in  turn  must  synthesize  identification  data  frpm  the  D3S  in  order  to  reconcile  discrepancies  with 
the  indirect  data  furnished  by  the  ISS.  Therefore,  to  satisfy  the  fidelity  requirements,  the  simulation  of 
these  positions  must  be  accomplished  with  LPUs. 

When  LPUs  are  used,  the  manning  of  the  operator  positions  becomes  an  important  question.  As  the  number 
of  manned  positions  rises,  so  do  the  difficulties  in  test  control,  expense,  end  risk  of  confounded  results. 
Consequently,  it  is  important  to  keep  the  number  of  manned  positioni  to  tho  minimum  necessary  for  experimen¬ 
tal  fidelity.  The  approach  taken  will  be  to  have  separate  positions  only  for  those  Individuals  who  either 
perform  or  frequently  support  identification  as  a  major  function.  Combined  positions  will  be  used  for  those 
individuals  who  are  not  primary  players  and  who  do  not  frequently  support  identification  positions.  Steps 
will  be  taken  to  ensure  that  realistic  workloads  are  placed  on  the  multirole  individuals  so  that  the  res¬ 
ponse  delays  are  realistic. 

The  testbed  will  employ  computer  models  in  cases  where  well-defined  physical  processes  are  to  be 
modeled  or  where  the  fidelity  requirements  for  representing  the  man-machine  interaction  are  leas  severe. 

These  models  fall  into  two  categories:  interactive  and  noninteractive. 

e  Interaotiva  modeU  (in  real-time)  react  dynamically  to  perceived  changes  in  the  air  battle  situation. 
They  may  receive  inputs  such  as  data  link  messages  from  the  other  models  or  LPUs  and  may  Initiate 
messages  either  on  their  own  or  in  response  to  stimuli.  The  execution  of  these  models  is  unpredic¬ 
table  and  is  conditional  on  the  specific  dynamics  of  the  air  battle.  The  applications  for  inter¬ 
active  models  will  be  as  follows: 

-  Sensor  models:  these  must  react  to  events  such  as  aircraft  kills,  removal  of  jammers,  and 
selection  of  operating  modes, 

-  Missile  endgame  models:  real-time  interactive  missile  models  will  be  employed  to  accomplish 
ruel-time  removal  of  killed  aircraft. 

-  Man-in-the-loop  system  models:  these  will  emulate  manned  systems  where  fidelity  of  represen¬ 
tation  Is  judged  to  have  minor  impact  on  the  testing  results,1 

-  Dynamically  controlled  aircraft  models:  these  will  represent  those  aircraft  in  the  scenario 
whose  flight  trajectories  and  actions  must  be  dynamically  controlled. 


'These  constitute  facilities  that  only  indirectly  support  identification--being  either  neighboring  systems 
located  in  the  simulation  background  area  or  higher  echelon  arid  peripheral  facilities  that  are  infrequently 
accessed. 


•  N oninteraotive  models  do  not  react  to  the  air  battle  dynamics.  They  are  u  less  complex  class  of 
models  and  simply  generate  selected  messages  and  actions  at  preprogrammed  times  according  to  a 
script  prepared  prior  to  the  test.  These  models  are  considered  suitable  for  omulating  those 
facilities  that  do  not  dynamically  interact  with  the  identification  process,  but  that  provide 
orders,  procedures,  and  other  information  on  a  one-way  basis.  This  would  apply  to  certain  higher 
echelon  planning  facilities.  Noninteractivc  models  will  also  be  the  means  of  representing  those 
aircraft  following  programmed  flight  profiles. 

TEST  CONTROL  AND  ASSESSMENT 

The  complex  and  distributed  nature  of  the  identification  process  makes  controlled  testing  a  very  demand¬ 
ing  task.  The  test  conditions  will  entail  executing  a  highly  complex  scenario  involving  operations  with 
many  human  participants  at  dispersed  locations.  Provisions  must  be  made  for  adequate  control  and  monitoring 
of  the  test  execution,  as  well  as  extraction  and  processing  the  necessary  data.  This  includes  the  ability  to 

•  Prepare  and  edit  scenarios, 

•  Support  the  training  of  test  participants  in  new  procedures  to  be  tested. 

•  Synchronize,  coordinate,  and  distribute  the  stimulation  of  all  test  participants. 

•  Perform  real-time  removal  of  killed  aircraft. 

•  Monitor  the  status  and  readiness  of  all  testbed  elements. 

•  Monitor,  in  near -real -time,  key  parameters  and  test  events  occurring  at  all  participating  testbed 
facilities, 

•  Extract  data  from  all  testbed  elements  to  obtain;  (1)  as  a  first  priority,  data  to  permit  recon¬ 
struction  of  all  events  affecting  each  simulated  aircraft;  (2)  as  a  second  priority,  diagnostic 
data  for  interpreting  why  actions  wore  taken. 

•  Coordinate  all  data  extraction  and  recording  activities,  occurring  locally  and  remotely. 

•  Provide  sufficient  quick-look  analysis  of  test  data  to  determine  if  a  successful  test  run  was 
achieved. 

•  Provide  adequate  data  reduction  and  automatic  analysis  capability. 

TEST8HD  REALIZATION 

The  realization  of  the  testbed  must  conform  to  the  strategy  planned  for  the  progressive  evolution  of 
tho  evaluation  program  and  the  modifications  and  expansions  anticipated  ovor  its  lifetime. 

As  noted  in  the  Programiatia  Features  section,  the  evaluation  program  is  structured  to  examine  progres¬ 
sively  incronsing  levels  of  systeip  complexity  ranging  from  a  fully  autonomous  and  decentralized  operational 
mode  to  tho  fully  Intact  centralized  air  defense  system.  This  progression  is  based  on  the  principle  that 
it  is  easier  to  go  from  a  simple  to  a  complex  testbod  as  each  testing  stage  benefits  from  the  experience 
guined  in  the  prior  stages.  This  testing  strategy  implies  u  progressive  expansion  of  the  testbed  occurring 
in  six  steps  as  follows; 

I,  Autonomous  SAM  battery 

II.  Autonomous  SAM  battalion 

III.  Group  control  of  SAMs 

IV.  Generic  USA-USAF  ground-based  C2  system 

V.  NAEH  augmentation  of  ground  systems 

a.  Augmentory  sensors  mode 

b.  Backup  CRC  mode 

VI,  Pull  NATO  Gz  system 

The  required  phasing  of  the  testbed  buildup,  in  terms  of  the  C2  facilities  and  air  defense  weapons  to  be 
represented,  is  shown  in  Pigure  8.  The  development  and  implementation  cycle  must  be  geared  to  this  progres¬ 
sion,  mooting  increasingly  demanding  requirements  at  each  step.  The  testbed  should  be  designed  to  facili¬ 
tate  tho  required  sorlos  of  modular  expansions  to  the  final  full  system  configuration. 

There  are  several  reasons  why  flexibility  is  required  in  tho  identification  testbed; 

e  Imprecise  definition  of  the  air  defense  system .  The  IPPN  Evaluation  Program  will  focus  on  the  mid- 
1980s  time  period,  assessing  the  identification  capability  that  might  evolve  by  that  time  if  current 
trends  in  c'  system  and  identification  sensor-development  and  deployment  continue  according  to  pro¬ 
jections,  Some  of  these  systems  will  be  only  vaguely  defined  at  the  time  of  the  earlier  stages  of 
tho  testbed  development.  Therefore,  frequent  revisions  can  be  oxpected. 

•  Necessity  for  incorporating  proposed  system  improvements.  There  must  be  sufficient  flexibility  to 
allow  the  new  software  algorithms,  sensors,  display  concepts,  etc.,  to  be  Incorporated.  This  will 
Include  items  such  as  Mark  XII  improvements,  new  identification  sensors,  automatic  data  links,  and 
now  switch  actions  and  display  formats.  Other  enhancements  such  as  trial  algorithms  for  fusion  of 
local  identification  data  sources  and  correlation  of  1SS  data  will  need  to  be  Integrated  into  the 
operational  software  of  the  various  tactical  data  and  weapon  systems  participating  in  the  testbed. 

•  Aooomodation  of  testing  variants.  The  testbed  must  be  able  to  easily  change  the  various  environ¬ 
mental  factors  and  must  be  roconfigurable  to  represent  various  disruptions  to  the  cJ  system  expected 
under  combat  conditions. 


•  Vnantioipated  modifiaationa.  As  the  testing  progresses  and  experience  is  gained,  improvements  to 
the  testbed  will  be  desired.  The  testbed  should  be  capable  of  being  easily  modified  to  implement 
these  improvements. 

The  need  for  flexibility  as  detailed  above,  dictates  the  use  of  a  high-level  computer  language  and  a  general- 
purpose  computer  operating  system.  In  addition,  provisions  should  be  made  for  inclusion  of  adequate  software 
development  aids  and  future  hardware  expansion. 

IDENTIFICATION  TESTBED  ARCHITECTURE 

Several  alternative  architectures  are  potentially  capable  of  satisfying  the  requirements  identified  in 
the  preceding  section  and  are  under  active  consideration.  These  embody  varying  degrees  of  centralized  test¬ 
bed  management.  The  final  selection  uf  an  architecture  is  the  prerogative  of  the  JTF  and  will  be  based  on 
the  findings  of  cost  and  feasibility  studies  now  underway.  This  section  briefly  reviews  the  essential  fea¬ 
tures  of  the  one  option  that  tentatively  appears  to  be  the  most  well-suited— a  centrally-controlled  distributed 
testbed  concept  patterned  after  the  approach  used  in  the  T ACS/ TABS  testbed. 

OVBRVIBN  OF  THB  CENTRALLY-CONTROLLED  DISTRIBUTED  CONCEPT 

This  section  provides  a  brief  overview  of  the  essential  features  of  the  centrally-controlled  distributed 
concept  and  its  underlying  rationale, 

The  centralised  concept  employs  an  array  of  geographically  distributed  test  facilities  with  a  central 
simulation  facility  (CSF)  providing  strong  centralized  control,  This  CSF  directs  and  monitors  all  testing 
operations  and  is  the  source  of  all  stimulation  for  the  entire  testbed.  This  concept  represents  a  middle 
ground  between  a  fully  unified  testbed  having  all  facilities  and  resources  concentrated  at  one  installation,1 
and  a  fully  decentralised  testbed  composed  of  locally  controlled,  widely  dispersed  facilities  coordinated  by 
voice.2 

The  tradeoffs  among  these  various  architectures  are  the  extra  development  cost,  time  required,  and  risk 
of  creating  special  centralised  facilities  versus  the  savings  they  produce  in  facilitating  the  actual  test 
operations.  The  final  decision  will  be  based  on  the  total  cost,  risk,  and  time  required  for  the  entire  pro¬ 
gram,  which  is  the  sum  of  both  the  development  and  test  operations  phases.  The  centralized  control  concept 
offers  effective  control  of  test  operations  at  reasonable  development  cost3  and  therefore  appears  particularly 
well  suited  to  the  above  criteria. 

To  ensure  that  the  simulated  inputs  driving  the  various  participating  systems  will  be  standardized  and 
controllable,  the  functions  associated  with  simulation  and  control  will  be  physically  and  logically  segregated 
from  the  live  systems  being  evaluated.  A  common  simulation  system,  specifically  developed  for  the  identifi¬ 
cation  evaluation,  will  be  employed.  Under  this  approach,  the  built-in  simulation  features  currently  avail¬ 
able  in  some  of  the  systems  under  study  will  not  be  used.  This  is  to  avoid  problems  that  could  develop  from 
using  a  variety  of  simulators,  each  developed  to  satisfy  different  and  often  unknown  criteria. 

The  testbed  facilities  will  be  divided  into  two  functional  entities:  (1)  the  various  live  participating 
units  (LPUs)  representing  the  main  NATO  and  Warsaw  Pact  tactical  data  and  weapon  systems  operating  in  the 
simulation's  core  region;  and  (2)  a  simulation  control  system  used  to  stimulate,  control,  and  monitor  the 
testbed,  and  also  to  emulate  systems  in  the  simulation's  background  Tegion. 

The  general  architecture  for  the  centralized  control  testbed  concept  is  shown  in  Pigure  9.  With  this 
concept,  the  simulation  control  system  will  consist  of  three  components:  (1]  a  CSF  that  will  support  and 
control  all  testbed  operations;  (2)  a  series  of  satellite  simulation  units  (SSUs),  one  servicing  each  LPU 
site;  and  (3)  a  data  processing  support  facility. 

The  SSUs  will  act  as  interface  buffers  between  the  LPUs  and  the  simulation  control  system.  To  minimize 
cost  and  programmatic  risk,  the  live  units  required  for  the  testbed  will  be  assembled  from  existing  facilities. 
Modifications  to  these  facilities  will  be  minimised  by  tailoring  each  SSU  to  the  peculiarities  of  the  LPU 
it  services.  Since  roost  facilities  that  are  to  be  used  for  the  LPUs  are  not  available  full  time  or  arc  diffi¬ 
cult  to  relocate,  they  will  remain  in  place  and  will  be  connected  to  the  testbed  via  telephone  lines.  The 
identification  testbed  will  therefore  be  geographically  distributed. 

Use  of  a  distributed  architecture  makes  communications  an  important  factor.  As  indicated  in  Pigure  9, 
there  will  be  two  networks,  each  including  both  voice  and  data  channels:  (1)  a  test  control  network  over 
which  all  monitoring,  control,  and  stimulation  information  will  be  passed;  and  (2)  an  operational  network 
comprising  the  operational  circuits  that  normally  interconnect  the  various  air  defense  system  nodes.  The  CSP 
will  be  the  hub  through  which  all  communications  are  routed  (Figure  9).  This  routing  allows  (1)  all  opera¬ 
tional  message  traffic  to  be  monitored  and  recorded  at  the  CSP,  (2)  rapid  reconfiguration  to  any  of  the  Cz 
configurations  required,  and  (3)  control  and  stimulation  to  be  centralised  and  conducted  from  the  CSF  via  the 
test  control  network. 

SIMULATION  CONTROL  SYSTBM 

This  section  provides  additional  details  on  the  attributes  of  the  simulation  control  system. 

The  simulation  control  system  will  support  the  following  testbed  activities: 
e  Software  checkout  and  modification 


lThe  Federal  Aviation  Administration's  air  traffic  control  simulation  facility  at  the  National  Aviation 
Facilities  Experimental  Center  in  Atlantic  City,  N.J.,  is  one  example  of  this  approach. 

2The  NATO  Programming  Center's  NADGE  simulation  exercise  concept  is  an  example  of  this  approach. 

3The  development  cost  is  estimated  to  be  considerably  less  than  the  manpower  costs  for  the  test  operations. 


•  Test  preparation 

•  Test  operations 

•  Post-test  evaluation 
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The  processing  tasks  associated  with  these  functions  will  be  divided  among  the  CSF,  the  SSUs,  and  a  data 
processing  support  facility.  The  general  approach  will  be  to  strive  for  a  high  degree  of  centralization 
of  all  testbed  functions  at  the  CSP.  The  degree  to  which  full  centralisation  is  achieved  in  practice  will 
be  governed  by  tradeoffs  between  factors  such  as  coat,  technical  risk,  and  schedule  constraints. 

To  keep  CSP  costs  at  an  acceptable  level,  those  tasks  that  demand  large  computer  resources  but  can  be 
done  offline  on  a  low-priority,  non-real-time  basis,  will  be  considered  for  implementation  at  the  support 
data  processing  facility.  This  support'  facility  will  be  a  batch  processing  computer  center  located  in  the 
vicinity  of  the  CSP  site.  As  another  example,  functions  that  might  creata  excesaive  communications  loads 
if  implemented  at  the  CSP  may  be  offloaded  onto  the  SSU  minicomputers  (e.g.,  recording  of  large  amounts  of 
extracted  data,  modeling  of  sensori  feeding  a  particular  LPU) . 

As  the  build-up  of  the  testbed  progresses,  the  CSP  will  include  the  software  and  interactive  program¬ 
ming  aids  to  support  development  and  debugging  of  software  modifications  and  modular  expansion  of  the 
system  to  new  levels  of  capability.  To  facilitate  this  process,  the  CSF  will  be  developed  using  commercial 
minicomputer  components.  All  applications  programs  will  be  written  in  a  high-level  language  (e.g.,  FORTRAN) . 

A  commercially  available  computer  with  a  real-time  disk  operating  system  having  interactive  editing,  file 
management,  compilers,  loaders,  and  debug  aid  features,  will  be  used,1  The  CSP  hardware  will  include  CRT 
display  terminals,  medlum/high-spoed  printers,  disk  memory,  and  tape  drives. 

The  simulation  control  system  will  include  a  package  that  provides  the  capability  to  generate  and 
modify  testing  scenario  tapts.  A  scenario  tape  will  consist  of  aircraft  flight  events,  scripted  avionics 
actions,  and  other  programmed  events.  An  interactive  keyboard  and  a  graphics  display  terminal  will  be 
included  to  permit  an  operator  to  modify  quickly  an  existing  scenario  using  fast-forward  or  reverso  scanning. 

A  threat  library  of  attack  profiles  and  aircraft  operating  characteristics  will  be  included  in  the  data 
bass.2  With  this  library,  the  operator  can  efficiently  assemble  any  desired  air  battle  using  only  a 
qualitative  description  of  the  scenario  entered, 

The  relationships  between  functional  elements  associated  with  the  test  operations  are  shown  in  Figure 
10.  The  CSF  will  originate  all  testbed  stimulation,  ensuring  that  proper  coordination  and  timing  are  main¬ 
tained  throughout  the  entire  testbed.  The  basic  stimulants  will  be  preprogrammed  air  traffic  and  scripted 
events  read  from  the  scenario  tape.  The  capability  to  supplement  this  as  necessary  with  overlaid  dynamic 
inputa--entered  by  operators  using  the  set  of  interactive  display  terminals  shown  in  Figure  10--will  be 
available.  These  operators  can  play  the  role  of  pilots,  controlling  the  actions  and  flight  paths  of  simu¬ 
lated  aircraft. 

A  family  of  interactive  software  models  will  represent  the  sensors,  These  will  act  on  the  merged 
programmed/dynamic  eir  truth  for  the  aircraft  flying  within  their  coverage  envelope,  determining  the  sensor 
response  to  the  input  stimuli,  injecting  measurement  errors  consistent  with  the  electronic  environment,  and 
synthesizing  a  sensor  data  report  for  each  detected  true  or  false  target.  To  minimize  communications  costs, 
sensor  models  will  reside  at  the  live  or  emulated  facility  they  aro  feeding.  Thus,  some  models  will  reside 
in  SSUs  while  others  will  reside  in  the  CSP.  Also,  in  cases  Where  raw  video  signals  are  required  to  drive 
radar  processors  in  the  live  units,  video  generators  will  be  incorporated  into  the  SSU  to  provide  the  required 
analog  signals  for  the  LPU,  These  generators  will  be  driven  by  the  software  models. 

To  save  communications  costs,  air  truth  data  will  be  distributed  to  a  LPU  only  when  the  aircraft  is 
within  coverage  of  that  unit's  sensors.  This  condition  will  be  determined  in  the  CSF  computer  using  pre¬ 
stored  coverage  maps,  incorporating  both  local  terrain  masking  and  radio  horizon  effects.  Moreover,  only 
events  (e.g.,  the  occurrence  of  a  maneuver)  will  be  distributed,  thereby  avoiding  the  necessity  for  high- 
rate,  periodic  transmissions  of  absolute  position  updates.  The  actual  positional  computations  will  be 
performed  at  the  SSUs  using  analytical  flight  models  installed  in  the  SSU  processors.  These  will  integrate 
event  data,  using  a  prestored  aircraft  flight  characteristics  data  base,  to  predict  the  exact  position  of 
the  aircraft  at  the  time  of  the  next  sensor  observation.  These  outputs  will  activate  a  set  of  sensor  models 
residing  in  tho  SSU  which  represent  tho  LPU  sensor  array. 

Tho  package  of  models  designed  to  represent  those  facilities  in  the  testbed  that  are  not  being  played 
live  will  reside  in  the  CSP.  All  the  positional  computations  and  sensor  modeling  for  these  emulated  facil¬ 
ities  will  also  be  performed  there, 

In  the  cases  where  emulated  facilities  are  required  to  have  a  communications  interface  with  a  live 
facility,  the  following  provisions  will  be  made.  If  only  a  data  interface  is  required,  it  will  be  accom¬ 
plished  via  an  actual  operational  data  link,  Where  a  voice  interface  is  also  required,  the  concept  of 
operations  depicted  in  Figure  11  will  be  followed,  With  this  concept,  a  multirole  operator  from  the  testing 
staff  will  act  as  the  speaker.  He  will  control  the  operation  of  a  number  of  models,  listening  and  respond¬ 
ing  to  the  voice  contacts  and  Initiating  voice  transmissions  on  cue  from  the  models,  A  display  terminal 
will  provide  prompts  and  other  data  as  necessary  to  assist  him  in  performing  the  above  functions. 

Real-time  removal  of  killed  aircraft  will  be  accomplished  using  missile  endgame  models  residing  in  the 
CSF,  which  will  be  executed  whenever  an  "engage"  action  occurs  at  any  of  the  represented  weapons.  If  the 
aircraft  is  indicated  as  kilted,  further  dissemination  of  its  air  truth  will  be  inhibited. 

The  CSP  will  include  circuit  switching,  buffering,  and  format  translation  equipment  to  permit  it  to  act 
as  a  central  switch  point  for  the  operational  communications  network,  This  will  allow  dynamic  reconfigura¬ 
tion  to  any  of  the  C2  modes  of  interest  to  be  accomplished  quickly.  The  communications  processing  package 

‘Digital  Equipment  Corporation's  RSX11-D  operating  system  is  an  example  of  the  capabilities  required. 

2The  NATO  Programming  Center's  throat  library  is  one  possible  source  for  this  data  base. 
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will  allow  all  operational  and  test  control  data  messages  to  be  monitored  and  recorded  on  tape  or  disk. 

The  CSF  will  serve  as  the  central  command  post  for  the  testbed  and  will  Include  a  number  of  control  con¬ 
soles  and  voice  communications  outlets  dedicated  to  this  purpose.  This  equipment  will  display  the  status 
information,  provide  the  switch  actions,  and  provide  the  cosssunications  fox  the  test  director  to  assess  the 
testing  situation  and  take  appropriate  actions. 

Data  extraction  is  another  important  function  performed  in  the  test  operations  mission.  To  meet  the 
requirements  delineated  in  the  Teethed  Requiremnte  section,  the  data  recording  design  goal  will  b*  to  pro¬ 
vide,  at  a  minimum,  the  data  necessary  to  permit  time-ordered  reconstruction  of  the  systeei's  perception  of 
any  aircraft  in  the  scenario  and  all  actions  taken  affecting  that  aircraft,  in  addition,  at  much  diagnostic 
data  as  it  reasonably  possible  will  be  recorded.  The  recording  of  diagnostic  data  will  be  selectable  depend¬ 
ing  upon  the  loading  conditions  in  the  test.  To  minimise  the  multiplicity  of  data  tapes,  the  data  recording' 
will  be  centralized  as  much  as  possible  depending  on  the  data  communication  costs  affordable  for  this  func¬ 
tion.  It  is  expected  that  all  data  items  flowing  through  ths  CSF  will  bs  recorded  there.  Thi*  will  be 
supplemented  by  selectable  portions  of  the  participating  unit  data  bases,  transmitted  to  the  CSF  for  monitor-,' 
ing  and  racording.  In  addition,  the  organic  recording  facilities  of  the  LPU*  themselves,  augmented  where 
required  by  SSU  recording  capability,  will  be  used  to  record  the  local  data  bast  to  the  highest  feasible 
level  of  detail  and  sampling  rate. 

« 

Poet-test  data  processing  will  consist  of  two  types  of  capabilities:  quick-look  svalustion  and  extonded 
analysis.  The  quick-look  evaluation  will  be  performed  in  near -reel -time  using  the  data  processing  hardware 
capabilities  of  ths  CSP.  To  meat  this  need,  the  CSF  will  be  able  to  provide  aggregated  turneries  and  filtered 
playbacks  of  the  data  extracted  from  its  own  internal  data  base.  Theie  will  allow  indication  of  a  successful 
test  and  preliminary  assessment  of  results, 

The  extended  tnalysis  capability  will  employ  more  extensive  resources  offsred  by  the  support  data  pro¬ 
cessing  facility.  An  existing  facility  that  faatures  extensive  peripherals,  Interactive  terminals,  end 
graphics  capability  will  be  chosen  for  this  purpose.  It  will  merge  the  multiple  extractor  tapes  from  the 
various  LPU  sites  with  the  CSP  tape  to  produes  a  masttr  merged  data  set.  This  master  data  set  will  then  be 
chronologically  ordered  and  sorted  into  a  set  of  distinct  files,  each  describing  the  timeline  of  all  event* 
for  an  aircraft  played  in  the  scenario.  A  library  of  automatic  data  analysis  programs  will  be  developed  to 
process  these  files  and  extract  the  measures  of  performance  requiredto  resolve  the  critical  issues.  In 
addition,  an  extensive  set  of  interactive  diagnostic  analysis  aids  will  be  made  available.  These  will  enable 
a  data  analyst  to  filter  the  data  base  by  time,  by  air  target  number,  by  target  classification,  and  by 
facility.  Data  can  be  selected  for  either  tabular  or  graphic  display.  The  amount  of  hard  copy  will  be 
minimized  and  will  be  provided  only  for  specific  records  requested  by  the  analyst. 

Figure  12  shows  the  layout  envisioned  for  the  CSF.  It  comprises  four  areas:  a  testbed  command  center 
where  observation,  control,  and  monitoring  would  occur;  a  computer  room  containing  the  data  processing  hard¬ 
ware  and  peripherals;  a  software  development  area  containing  a  number  of  CRT  terminals;  tnd  an  interactive 
emulation  area  where  the  simulated  pilots  and  the  multirole  operators  of  the  emulated  facilities  modsls 
would  be  located.  Figure  13  is  an  artist's  rendition  of  the  testbed  command  center  showing  the  large  screen 
display,  status  boards,  test  oontrol  consoles,  and  an  observation  gallery.  The  size  and  component  element* 
of  a  typical  S8U  are  indicated  in  Figure  14. 

Due  to  its  unique  requirements,  the  CSF  is  the  only  portion  of  the  testbed  thst  cannot  be  provided  by' 
an  existing  facility.  However,  there  are  available  a  numb*  r  of  off-the-shelf  simulation  systems,  of  mors 
limited  capability,  that  could  provide  a  starting  point  for  creating  the  CSP.  This  would  reduce  the  cost 
and  risk  as  compared  to  starting  afresh.  These  systems  are  being  reviewed  to  determine  which  of  them  offers 
the  best  initial  point  for  a  buildup  to  the  CSF  requirements--at  a  minimal  cost  and  in  tho  shortest  time. 

The  location  of  the  site  selected  for  the  CSF  in  relation  to  the  LPUs  is  highly  important  to  the  manage¬ 
ment  and  successful  execution  of  the  test  program,  A  number  of  factors  must  be  weighed  in  this  selection: 

•  Communications  costs 

•  Travel  time  between  CSF  and  LPUs 

•  Proximity  of  an  adequate  support  data  processing  facility 

•  Availability  of  necessary  facilities  (e.g.,  billets  for  JTF  staff) 

•  Security  provisions 

•  Availability  of  support  personnel. 

A  study  is  being  conducted  that  will  consider  these  factors  and  recoimsend  a  site. 

LIVE  PARTICIPATINfi  UNITS 

The  LPUs  constitute  those  air  defense  systems  that  will  be  "live  players"  in  the  teetbed.  Under  the 
centrally-controlled  distributed  testbed  concept,  these  units  will  be  assembled  from  existing  systems  in 
the  United  States  and  connected  to  the  testbed,  Whero  possible,  the  LPUs  will  be  actual  production,  units. 

As  a  second  choice,  a  trainer  or  an  engineering  simulator  for  representing  the  system  will  be  used.  When 
neither  of  these  are  feasible,  a  general-purpose  simulation  facility  will  be  modified  and  used  as  a  surrogate. 

A  survey  of  all  known  U.  S.  air  defense  facilities  was  conducted  to  identify  and  characterize  those 
that  could  potentially  fulfill  the  needs  of  the  testbed.  Figure  15  summarizes  the  survey  results,  showing 
the  location,  type,  and  application  of  facilities  being  considered  at  potential  LPUs. 

The  final  selection  of  facilities  has  not  been  made  at  this  time.  It  will  be  driven  by  considerations 
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such  as  availability,  interface  requirements,  location,  and  supporting  facilities.  The  need  for  brevity 
precludes  a  review  in  this  paper  of  the  tradeoffs  governing  particular  facility  selections  for  all  the  LPUs. 
However,  to  illustrate  how  the  various  types  of  facilities  (i.e.,  production  unit,  trainer,  general-purpose 
simulator)  will  be  employed,  three  are  discussed:  the  Battalion  Operations  Center  (BOC),  the  NATO  Airborne 
BaTly  Nnming  (NAEW)  aircraft,  and  the  Warsaw  Pact  (KP)  C2  surrogate. 

A  number  of  BOC  (TSQ-73)  production  units  are  based  in  CONllS.  The  system  at  Tort  Bliss,  Texas,  is  cur¬ 
rently  an  active  participant  in  the  TACS/TADS  testbed.  Therefore,  an  interface  to  another  similar  remote 
simulation  eonter  should  be  relatively  easy  to  accomplish.  An  operational  BOC  can  be  readily  interfaced 
with  the  simulation  control  system  by  switching  off  its  live  radar  and  feeding  simulated  radar  video  signals, 
generated  by  the  SSU,  to  the  radar  input  channel.  Software  modifications  to  test  new  automated  identifica¬ 
tion  aids  and  to  provide  additional  data  extraction  and  recording  would  be  required.  However,  theie  can  be 
incorporated  into  a  special  version  of  the  operational  program  that  would  be  loaded  prior  to  the  start  of  a 
test.  A  further  consideration  is  that  the  system  is  owned  by  the  U.S.  Army,  which  has  a  high  interest  in 
the  success  of  the  evaluation,  These  considerations  suggest  that  the  use  of  an  operational  TSQ-73  as  the 
BOC  participating  unit  is  an  attractive  option. 

A  number  of  operational  B-3A  aircraft,  the  U.S.  forerunner  of  the  NAEW,  are  based  in  CONUS.  However, 
these  systems  are  heavily  utilised  and,  in  contrast  with  the  BOC,  are  unlikely  to  be  committed  to  the  test¬ 
bed  as  this  would  constitute  an  inefficient  use  of  a  large  aircraft.  Fortunately  there  are  a  number  of 
B-3A  simulators  that  are  potentially  available:  two  used  for  crew  training  and  several  others  for  develop¬ 
ment  purposes.  Interface  with  the  testbed  would  occur  through  a  digital  interface,  with  the  SSU  supplying 
digital  radar  reports  to  the  NAEW  processor,  The  simulator  would  copy  the  TACS/TADS  testbed  interfaces 
with  the  B-3A,  currently  under  development.  As  in  the  case  of  the  BOC,  a  special  operational  program  version 
will  be  developed  for  use  during  the  testing.  These  considerations  point  to  the  use  of  one  of  the  B-3A  simu¬ 
lators  as  the  most  viable  choice  for  the  NABW  participating  unit. 

The  WP  simulator  LPU  will  represent  key  Pact  frontal  air  defense  C2  elements  defending  a  slice  of  the 
Pact  territorial  airspace  in  the  NATO  Central  Region.  It  will  include  only  those  elements  that  could  poten¬ 
tially  influence  the  NATO  identification  system,  for  both  defensive  and  offensive  operations.  A  number  of 
facilities  would  bo  involved  in  this  role,  but  these  could  be  represented  using  a  single  simulator  that  was 
appropriately  partitioned.  Since  the  evaluation  focus  is  on  how  the  MATO  operations  are  inf luenced' by  the 
actions  of  the  Warsaw  Pact,  the  fidelity  requirements  for  the  WP  simulator  LPU  are  considerably  less  severe. 
Thus,  little  disadvantage  would  result  from  employing  a  more  aggregated  C2  representation  of  this  system. 
Consequently,  a  generic  C2  simulator  facility  would  appear  to  be  the  best  choice  for  representing  the  WP  C2 
system. 


ILLUSTRATIVE  TEST  DESIGN 

In  a  simulation  tasting  program,  the  effort  directed  to  the  formation  of  the  testbed  must  be  supplemented 
by  adi^oate  planning  for  meaningful  experiments  with  the  resource  being  created.  This  portion  of  the  paper 
addresses  the  important  question  of  experimental  design  and  provides  an  example  of  how  this  is  being  incor¬ 
porated  into  the  planning  of  the  overall  evaluation  program.  The  example  presented  pertains  to  the  portion 
of  the  test  program  that  examines  identification  when  an  NABW,  acting  as  a  backup  (IRC,  is  supporting  defen¬ 
sive  counterair  (DCA)  operations,  This  oxample  was  selocted  because  of  the  particular  interest  of  the 
conference  in  applications  to  airborne  systems.  These  experiments  are  planned  for  Stage  V  of  the  testing 
program,  at  which  point  the  NABW  simulator  and  the  airborne  interceptor  simulator  will  have  been  incorporated 
into  the  testbed.  The  segment  of  the  air  defense  system  that  will  be  represented  ami  the  testbed  facilities 
involved  are  indicated  by  the  shaded  elements  of  Figure  B. 

GENERAL  PROCEDURB 

The  general  procedure  being  usod  to  develop  the  experimental  designs  can  be  summarized  as  follows: 

e  Obtain  familiarization  with  the  concopt  of  operations  for  the  facilities  involved. 

e  Specify  the  identification  Issues  that  are  to  be  examined  and  the  criteria  by  which  they  will  be 
assessed. 

e  Identify  all  direct  and  confounding  variable  factors  and  their  possible  variants. 

e  Design  a  matrix  of  experimental  conditions  to  be  tested. 

•  Derive  a  testing  schedule  based  on  the  experimental  design. 

NAEW-DCA  CONCEPT  OF  OPERATIONS 

In  a  typical  air-to-air  encounter  involving  a  DCA  interceptor  under  NAEW  control,  the  following  events 
could  occur,  The  NAEW  aircraft  would  be  positioned  in  an  orbit  and  would  provide  early  warning  of  intruding 
aircraft,  at  a  range  determined  by  the  orbital  altitude  and  position,  the  BCM  conditions,  and  the  size  and 
altitude  of  the  aircraft,  These  aircraft  may  be  hostile,  or  they  could  be  homeward-bound  friendly  aircraft 
returning  from  offensive  air  support  missions.  The  actual  configuration  of  the  NAEW  crew  has  not  yet  been 
specified,  However,  if  it  is  compelled  to  function  as  a  backup  CRC,  it  is  postulated  that  the  NABW  crew  will 
include  a  surveillance  operator  who  will  initiate  and  maintain  tracking  of  detected  aircraft,  an  identifica¬ 
tion  officer  (IDO)  who  will  assign  nn  identity,  and  a  weapons  controller  who  will  direct  a  fighter  to  the 
vicinity  of  the  threat.  The  IDO  will  utilize  both  direct  identification  aids  and  any  indirect  information 
available  to  him  to  arrive  at  an  identity  decision.  For  simplification,  the  scope  of  this  tosting  phase  will 
limit  the  indirect  information  to  nonreal-time  alerting  of  the  presence  of  enemies  or  friends  in  the  general 
area,  The  NAEW  aircraft's  direct  aids  will  consist  of  selected  organic  active  and  passive  identification 
devices,  flight  plan  data,  and  knowledge  of  airspace  control  procedures.  The  NABW  aircraft  may  also  have 
automatic  decision-making  aids  imbedded  in  the  operational  computer  program  that  perform  the  fusion  of  all 
indirect  and  direct  sources  of  identification  data  into  an  identification  decision.  Using  these  "black  box" 
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and  system  aid*,  the  IDO  will  attempt  to  provide  timely  discrimination  between  friendly,  hostile,  and 
neutral  aircraft . 

If  the  assignment  is  other  tha>  v  ’ .lend,  depending  on  the  tactical  situation,  the  weapons  controller 
may  dispatch  interceptors  to  attempt  \  i  ascertain  or  confirm  identity,  and  if  necessary  to  counter  the 
threat  under  one  of  three  model  of  coi.  <  '1:  broadcast,  loose, or  close  control.  In  broadcast  control, 
autonomously  operating  interceptors  pet i  .: /ling  the  area  are  alerted  to  the  presence  of  hostllea  or  unknowns 
by  means  of  broadcasted  position  information- -no  intaxcoptor  vectoring  is  performed.  In  the  other  two 
modes,  the  controller  pairs  available  interceptor  resources  to  the  threat.  In  loose  control,  the  intercep¬ 
tors  are  given  range  and  bearing  to  the  general  vicinity  of  the  threat;  the  individual  pilot  assumes  auton¬ 
omous  rssponsibility  for  the  intercept  snd  tactics  in  accordance  with  the  rules  of  engagement  (RGBs) .  In 
close  control,  the  controller  continually  vectors  the  aircraft  until  contact  with  the  threat  is  made. 

It  is  bayond-visual-range  (BVR)  engagement  that  la  of  most  interest  to  the  identification  program.  In 
SVR  conditions,  when  the  interceptor  pilot  finally  assumes  control,  he  must  acquire  and  lock  onto  the  target, 
identify  it  uaing  his  direct  onboard  identification  aids  and  any  indirect  identity  information  available, 
poaltion  his  aircraft  within  the  firing  envelope,  fire  and  guide  the  weapon,  and  then  execute  an  escape 
maneuver.  The  outcome  will  depend  on  the  missile  flyout,  target  vulnerability,  and  countermeaaure  actions 
taken  by  the  target. 

When  a  pair  or  more  of  interceptors  are  encountering  multiple  targets,  the  initial  period  of  the  engage¬ 
ment  la  crucial  to  the  outcome.  During  this  period,  in  addition  to  the  usual  piloting  taska,  tho  pilot  mutt 
(1)  perform  coordination  with  his  wingman,  (2]  interpret  his  own  onboard  radar  and  identification  aid*  data, 
and  (3)  correlate  his  own  data  with  indirect  data  provided  from  the  NABW  aircraft.  This  constitutes  an 
extremely  heavy  workload  for  the  pilot. 

ISSUES  TO  BE  EXPLORED  AND  CRITERIA  POR  ASSESSMENT 

The  Air  Porce  Avionics  Laboratory  is  embarking  on  a  simulation  program  to  evalute  the  identification 
performance  of  autonomous  airborne  interceptors  and  the  impact  of  improved  identification  performance  on 
interceptor  effectiveness.  The  IFFN  Evaluation  Program  will  not  duplicate  these  analytes  but  will  extend 
them  in  the  following  directions.  To  assess  the  utility  of  the  ISS,  a  baseline  will  be  established  to  deter¬ 
mine  the  levol  of  interoeptor  effectiveness  when  it  is  subject  to  alternative  levels  of  MEM  oontrol  (e.g., 
olose,  loose,  or  broadoaet  oontrol), 

In  particular,  an  assessment  will  be  made  of  the  extent  to  whioh  the  identification  capability  associa¬ 
ted  with  the  NAEW-PCA  syetam  restricts  airborne  interceptor  effectiveness.  To  establish  a  bound  on  this 
issue,  performance  can  be  evaluated  for  two  cases;  (1)  identification  is  assumed  known  for  a  target,  coinci¬ 
dent  with  detection  (i.e,,  "perfect"  identification  performance);  and  (2)  the  NAEW-DCA  system  must  identify 
aircraft  using  available  sources  of  information. 

These  results  will  provide  a  baseline  of  system  performance  and  suggest  the  potential  improvements  that 
can  be  obtained  by  enhancing  identification  performance.  If  it  is  demonstrated  that  enhanced  identification 
performance  can  significantly  Improve  interceptor  effestiveness,  a  sequence  of  exploratory  experiments 
should  be  conducted  to  assess  proposed  techniques  for  upgrading  the  identification  function.  This  raises 
the  following  subissues. 

e  To  what  extent  can  identification  performance  and  interceptor  effectiveness  be  enhanced  by; 

-  "Black-box"  enhancement  (e.g.,  an  enhanced  Mark  XII;  deployment  of  an  Electronic  Support  Measure 
(ESM)  System  on  the  NAEW  aircraft) . 

-  Subsystem  improvements  (e.g.,  sensor  synthesis  algorithms  for  the  airborne  Interceptor  and  NABW 
aircraft) . 

-  System  modifications  (e.g.,  use  of  a  digital  data  link,  with  relative  navigation  properties,  to 
support  tho  exchange  of  information  between  the  airborne  interceptor  and  the  NABW  aircraft) . 

Ab  notod  in  the  Progr&matio  Features  section,  these  issues  will  be  assessed  by  evaluating  two 
levels  of  figures  of  merit.  At  an  intermediate  level,  data  will  be  collected  to  characterize  the  sequence 
of  stops  loading  to  a  controlled  engagement.  Emphasis  will  be  placed  on  characterizing  the  detection  and 
identification  process  by  the  participants  (e.g.,  temporal  and  spatial  conditions  when  the  function  is  per¬ 
formed),  As  an  overall  figure  of  merit.,  the  likelihood  of  alternative  engagement  outcomes  will  be  computed 
(Figure  4)  for  specified  environmental  conditions. 

VARIABLES 

The  exploratory  evaluations  cited  in  the  prior  section  give  rise  to  a  significant  number  of  independent 
experimental  variables.  For  the  two  participating  systems,  these  include  variations  in  (1)  the  black  boxes 
composing  their  direct  subsystems  to  support  identification,  (2)  personnel  experience,  (3)  Identification 
fusion  algorithms,  (4)  level  of  control  (ranging  from  close  control  to  procedural  control),  and  (5)  level  of 
communications  between  the  two  systems  (ranging  from  unsecure  voice  to  a  secure,  BCM-resietant,  digital  data 
link  with  a  relative  navigation  capability),  A  conservative  estimate  of  the  number  of  test  configurations 
of  interest  exceeds  five  thousand. 

Each  of  these  test  configurations  may  require  evaluation  over  a  broad  spectrum  of  environmental  factors. 
A  representative  set  of  these  environmental  factors  Is  summarized  in  Table  1,  It  can  be  seen  that  If  all 
possible  combinations  of  system  configurations  a^H  environmental  par-meters  were  to  be  assessed,  it  could 
mandate  enormous  numbers  of  experimental  runs. 


EXPERIMENTAL  DESIGN  AND  SCHBDULB  IMPACT 


Since  the  number  of  possible  test  conditions  of  interest  is  so  large,  it  is  obvious  that  a  full  factor¬ 
ial  design  (i.e.,  one  that  tests  all  possible  conditions)  is  unrealizable.  Therefore,  it  is  important  to 
find  a  way  to  select  a  relatively  small  subset  of  test  conditions  that  can  be  run  within  the  time  constraints 
on  the  testing,  but  that  will  still  provide  valid  conclusions  on  the  Issues.  To  achieve  this,  a  combination 
of  enlightened  judgment  and  efficient  experimental  design  techniques  must  be  used  to  isolate  and  examine 
only  the  most  critical  factors. 

Prior  to  the  onset  of  testing,  filtering  techniques  including  analytical,  studies,  fast-time  computer 
simulations,  and  expert  judgment  should  restrict  the  factors  for  Initial  consideration  to  a  reasonable  num¬ 
ber  (between  IS  and  30).  Then  efficient  experimental  design  techniques,  especially  those  making  use  of 
sequences  of  fractional  factorial  experiments1,  could  probably  be  used  to  systematically  identify  and  study 
those  factors  having  largest  effects.  With  such  designs,  a  relatively  large  number  of  factors  can  be  exam¬ 
ined  using  s  relatively  small  number  of  test  conditions.  However,  there  is  a  penalty  associated  with  using 
an  experimental  design  that  is  made  up  of  only  a  portion  of  tho  full  set  of  experimental  conditions.  Since 
not  all  conditions  are  run,  not  all  effects  (both  main  effects  and  interaction's)  can  be  evaluated.  For  a 
given  experimental  design  size  (i.e.,  number  of  experimental  conditions  to  be  run)  only  a  certain  numbar  of 
effects  can  be  examined,  so  tho  tradeoff  is  between  the  number  of  main  effects  which  can  be  estimated  (the 
number  of  factors  which  can  be  considered)  and  the  number  and  order  of  interactions  which  can  be  estimated 
(the  number  and  complexity  of  relationships  between  factors  which  can  be  considered).  Thus,  whmn  many  fac¬ 
tors  are  examined  using  fractional  factorial  designs  with  a  small  number  of  runs,  unless  many  affects  are 
truly  negligible,  results  arc  likely  to  be  misleading.  A  way  to  avoid  this  difficulty  is  to  have  the  number 
of  runs  be  adaptive  to  the  number  of  significant  effects  discovered, 

An  example  of  one  adaptive  testing  approach  under  consideration  is  the  usage  of  fractional  factorial  ' 

designs  in  a  multi-stage  adaptive  testing  cycle.  In  this  cycle  the  first  stage  is  a  wide-coverage  screening 
experiment  where  a  relatively  large  number,  N,  of  factors  (say,  N  between  15  and  30)  are  examined  with  a 
relatively  small  number  of  runs  (possibly  as  small  as  N  *  1).  The  hope  is  that  many  effects  considered  will 
actually  prove  to  be  negligible  so  that  common  sense  can  be  used  to  interpret  initial  results  and  enable 
selection  of  relatively  few  factors  and  effects  for  further  study.  If  too  many  effects  are  large,  additional 
tuna  will  be  necessary  to  make  sense  out  of  the  results.  The  number  of  additional  runs  required  could  vary 

from  a  few  (2  to  4)  to  n  larger  number  (say,  256  if  N  >  15)  if  there  is  reason  to  suspect  that  all  main 

effects  and  two-factor  interactions  are  large.  Typically,  however,  a  total  of  2N  to  3N  runs  will  be  required 
to  become  reasonably  comfortable  that  the  most  important  effects  have  been  identified, 

Further  stages  of  the  adaptive  testing  cycle  could  proceed  In  two  directions.  First,  factors  identified 
as  critical  in  the  screening  experiment  cculd  be  studied  furthor,  especially  by  investigating  optimal  and 
break-down  conditions  for  quantitative  factors.  Second,  new  factors  could  be  added  as  the  testbed  expands. 
Systematic  use  of  fractional  factorials  and  other  formal  experimental  design  techniques  could  be  especially 
useful  when  adding  factors  since  each  new  series  of  runs  contributes  not  only  to  understanding  of  tho  new 
factor  but  also  to  increased  understanding  of  all  other  factors  under  consideration,  That  is,  formal  experi¬ 
mental  design  provides  a  framework  for  analyzing  test  data  not  simply  within  u  particular  testbed  configuration 
but  within  a  total  data  base  where  each  run  complements  every  other.  Furthermore,  since  many  of  tho  measures 
of  effectiveness  under  consideration  are  essentially  averages  of  many  observations  taken  during  a  run,  tho 
probabilistic  assumptions  (especially  independence  and  normality)  necessary  to  make  statistical  inferences 
using  analysis  of  variance  are  likely  to  be  satisfied  for  much  of  the  test  data.  Thus,  very  standard 
statistical  techniques  nre  likely  to  permit  justifiable  confidence  statements  about  test  results. 

It  is  estimated  that  the  above-described  testing  program  upplied  to  the  NARW-DCA  phase  of  the  identifi¬ 
cation  evaluation  would  require  about  four  to  six  months  to  complete  for  a  full  scientific  exploration 
of  all  factors.  This  time  could  be  reduced  if  the  number  of  factors  were  arbitrarily  restricted. 

mt 

CONCLUSIONS 

The  air  defense  systems  that  would  be  employed  In  a  large-scale  intense  conflict  have  grown  so  complex 
and  extensive  that  it  is  no  longes.  feasible  to  evaluate  then  fully  using  live  field  tests,  The  tremendous 
expense  involved,  the  numerous  peacetime  restrictions  on  airspace  and  electronic  emissions  have  constrained 
the  practice  of  large-scale  field  testing  to  tho  point  where  simulation  now  offers  greater  potential  for 
realism.  Even  so,  using  simulation  as  an  evaluation  tool  has  dangers,  and  its  potential  will  not  be  realized 
unless: 

(1)  The  simulation  concept  employed  is  adequate  for  examining  the  critical  issues  which  need  to  be 
studied, 

i 

(2)  An  adequate  experimental  design  is  prepared  and  followed. 

(3)  Steps  are  taken  to  make  the  simulation  findings  credible  to  the  user  community. 

This  paper  has  described  how  these  standards  are  being  applied  in  the  case  of  the  evaluation  of  the 
identification  process.  It  has  reviewed  the  comprehensive  approach  being  taken  to  define  the  testbed,  and 
described  a  proposed  distributed  testbed  with  centralized  control.  This  concept  offers  high  flexibility, 
controllability,  makesmaximum  use  of  existing  resources,  and  has  the  potential  to  offer  the  lowest  overall 
program  cost. 

Experimental  design  is  another  major  consideration  in  this  evaluation  where  there  are  a  large  number 
of  factors  influencing  the  effects  and  consequently  an  enormous  number  of  possible  test  conditions.  Since 
it  is  unfeasible  to  test  every  condition,  experimental  design  techniques  such  as  fractional  factorial  design 
must  be  employed  to  economically  screon  out  the  less  important  factors.  As  an  illustration  of  how  these 

* A  full  treatment  of  this  and  other  design  techniques  can  be  found  in  "Experiments:  Design  and  Analysis," 

J.  A,  John  and  M.  H.  QuenouiUc,  Mucmillan,  1977, 
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tools  can  be  used,  the  paper  described  the  experimental  design  efforts  for  a  portion  of  the  evaluation 
program  of  particular  interest  to  this  conference  (i.e.,  the  NABN  used  in  the  backup  CRC  mode  in  the  DCA 
mission) . 

Although,  simulation  has  the  potential  for  fewer  artificialities,  it  suffers  from  a  credibility  gap 
relative  to  results  from  field  testa.  This  gap  can  be  narrowed,  but  never  completely  eliminated,  as  the 
reason  for  using  simulation  paradoxically  precludes  any  complete  validation  (because  we  cannot  afford  to 
create  the  same  conditions  in  real  life) .  The  IFFN  program  plans  to  attack  this  problem  by  performing 
calibration  chacka  against  data  from  limited  field  txerciaes  in  the  hone  that,  by  demonatrating  that  the 
teatbed  can  duplicate  these  results,  confidence  in  it  will  be  established. 

The  IFFN  Evaluation  Program  !»■ still  in  its  early  stages  of  definition  with  testing  scheduled  to  begin 
by  mid  1981  and  axtend  over  a  period  of  two  to  three  yean.  Therefore  the  description  of  the  program 
presented  in  this  paper  should  be  considered  as  tentative  and  subjact  to  revision. 


Table  1 .  ENVIRONMENTAL  FACTORS 


Aircraft  Attributes  (for  friendly,  hostile,  and  neutral  aircraft) 


•  Muabers 

•  Danaitiai 

•  Miiaioni 

•  Apportionum* 

•  Aircraft  type,  Model 

-  Ordnanca  («.|.,  ilr*to«iir  aUr.Ui  charactariat ica) 

-  Avionic*  gear  X • « | • >  tranapandor  type) 

•  Plight  prefill0  (ti|.|  origin,  objective,  dynialcs) 


Electromagnet  ic  Attribute! 


a  Bit etroiagnitic  tntarfaranea  («,|.,  Hark  X  Mutual 
Intitfaranee) 

a  llactronic  eountaraaaaurei 

*  Active 

-•victim  (a.| t ,  intoraaptor  radar) 

■■typa  (i.gn  noiaa  jaaaing) 

•  ‘MVir 

•  •jmir  platform  (ii|.,  atindoff  Jaaaing) 

*  Paaaiva 

•>typt  (a. g . i  chaff) 

••platform 


Vercmt  *ge  of  aircraft  atiignod  to  altarnativa  aliiiom  (a.|., 
defanalva  countar  air,  cloac  air  auppart/bitt itfiold  inter* 
diction,  offeniiva  rountaralr)  | 

0Thla  will  be  conitralnad  by  poatulatid  vlilbllity  condition!  md 
terrain  faatur«a>  I 
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08!:  DIRECT  ID88YSTEM 
18!:  HUMECT  SUBSYSTEM 


Figure  1.  NATO  IDENTIFICATION  SYSTEM  CONCEPT 


Figure  6.  ARENA  OF  ACTION  SELECTED  FOR  IDENTIFICATION  TBSTBBU 
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Figure  8.  PROPOSED  TBST  PROGRESSION  FOR  IDENTIFICATION  EVALUATION 


KEY; 

|  •  UVI  FUtnOFAIM  UNtT 
f)  „  MMUUTION  CONTROL 


Q' 


,  Off-LIKI 
IIIKMI 

TttT 

-  coonoi 


OFCRARMAL 
COMMUMCATMM  NET 


BOC**BlttAttM  OpMlm  Cart* 
CNC-CwW  t  m*m  OwNw 
BRP-C*»tril4  MeMIm  PHt 
etNi-CMM  UiMMlMPMfty 
WC  4m$  OpMtllM  Confer 
m  umimi  mmnn  cmv 
NMW-NATO  AMlM  larty  Vanin 
sop‘4«fttft  Data  PvaaNian 
anf-nttwtt  iattfanii  um 
tAM"lwia  ta  Air  MMMt 


Figure  9.  ARCHITECTURE  FOR  THE  CENTRALIZED  CONTROL  TESTBED  CONCEPT 
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Figure  10,  SIMULATION  CONTROL  SYSTEM  FUNCTIONAL  ELEMENTS 
ASSOCIATED  WITH  TEST  OPERATION  ACTIVITIES 


Figure  11.  MANNED  INTERACTIVE  EMULATED  FACILITIES  MODBLS-- 
CONCEPT  OF  OPERATION 


Figure  12.  CENTRAL  SIMULATION  FACILITY  LAYOUT 


Figure  14.  SATELLITE  SIMULATION  UNIT  (SSU)  COMPONENTS 
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AIR-TO-AIR  ENGAGEMENT  SIMULATION 


Goetz  Wunderlich/Roland  Braun 
Industrleanlagen-Betriebsgesellschaf t  mbH  (IABG/SOL) 
8012  Ottobrunn 
Germany 


SUMMARY 


Since  5-10  years  various  one-versus-ono  air-combat  models  exist  in  several  institutes 
and  companies  and  are  used  mainly  for  comparison  studies  and  trend  analyses  in  the  area 
of  aircraft  and  weapon  evaluation.  Recent  events  (Southeast  Asia,  Middle  Bast)  have 
demonstrated  clearly  that  there  are  usually  more  than  two  aircraft  in  the  combat  arena. 
Therefore  German-MOD  decided  to  develop  a  multi -dual -model  which  considers  the  aircraft, 
its  avionics,  armament  and  the  pilots  behavior.  Of  great  importance  is  the  attachment 
algorithm  that  allocates  the  opponents  on  the  basis  of  active  and  passive  threat  values. 

Another  very  important  part  in  air-to-air  engagement  is  the  phase  prior  to  combat/  con¬ 
sisting  of  fighter  allocation,  combat  air  patrol  (CAP)  /  ground  controlled  Intercept  (GCI) 
capability,  Influence  of  early  warning  etc. 

To  gain  a  high  amount  of  flexibility  a  "two-stage"  solution  seems  to  be  most  promising. 
Preliminary  computations  based,  on  certain  sosnarios  will  be  performed  with  CAP-  and  GCI- 
models  (step  1),  producing  data  concerning  geometry,  fuel-  and  armament  atatus,  altitude, 
speed,  heading,  knowledge  of  enemy  strength  and  capabilities  eto.,  whioh  will  be  used  as 
input  for  the  combat  models  (step  2) . 


1 .  INTRODUCTION 

An  Important  factor  in  airborne  weapon  syatem  evaluation,  especially  in  the  early  defini¬ 
tion  phase,  is  the  calculation  of  probabilities  of  survival  and  success  with  respect  to 
an  expected  threat.  Therefore  producer  and  user  of  combat  aircraft  and  armament  are 
looking  for  appropriate  methods  to  calculate  the  qualification  for  combat,  in  other  words 
the  ability  to  survive  an  attack  of  a  hostile  fighter  and  to  counter  the  enemy. 

Despite  many  existing  1-vs-1  dogfight  models  and  manned  simulators  it  was  found  to  be 
attractive  to  develop  a  m-vs-n  air  combat  model  which  includes  airplana,  avionics, 
armament  and  pilot  behavior  and  also  takes  into  account  the  pre-engagement  phase,  i.a. 
fighter  allocation,  CAP/GCI-oapability  eto.  These  methods  will  be  described  in  the 
following  paper. 


2.  GENERAL  INFORMATION 

As  mentioned  above  both,  allocation  and  combat  phase,  should  bs  covered  by  this' method. 
To  keep  the  instrument  flexible  a  "two-stage"  solution  ssemsd  to  be  most  promising. 
Preliminary  simulations  based  on  certain  scenarios  will  be  done  with  CAP-  and  GCI-models 
(step  1),  producing  data  such  as  geometry,  fuel-  and  armament  statue,  altitude,  speed, 
heading,  information  statue  eta.,  which  will  be  used  as  input  for  the  combat  modsl 
(step  2)  . 


2.1  Fighter  Control 

2.1.1  General 

Before  starting  the  simulations  (Fig.  1),  assumptions  and  data  concerning  threat,  aarly 
warning,  airbase  status  and  allocation  planning  have  to  be  defined  as  input  for  ths 
tactical  employment  procedure,  The  informations  about  the  enemy  are  mainly  gathered  by 
autonomous  detection  or  early  warning  messages.  Search  and  detection  may  happen  either 
in  the  pre-engagement  phase  or  during  the  aerial  combat  itself. 

Flying  a  GCI-miasion  the  fighter  will  be  guided  to  the  point  of  potential  slr-to-air 
detection  or  a  favourable  weapon  release  point  by  groundbaeed  or  airborne  control  units. 
The  fighter  will  activate  its  radar  only  when  advised  by  the  fighter  controller  and 
usually  when  detection  or  launoh  is  promising.  In  contrary  during  a  CAP-mission  with 
various  preplanned  pattern  the  fighter  operates  its  sensors  permanently  and  searohee  for 
hostile  targets  autonomously. 

2.1.2  Ground  controlled  interception 

A  GCl-computation  for  example,  transfers  the  assumptions  and  data  of  fighter,  target, 
airbase  and  allocation  into  auitabls  flight-profiles  resulting  in  a  certain  final 
situation  including  or  excluding  detection.  Those  final  situations  are  input  to  the 
m-vs-n  air  combat  model  8ILKA. 

An  example  (Fig.  2)  may  show  liny;  the  GCI-mcdel  operates i  Assuming  an  air  defense  fighter 
base,  aircraft  and  armament  performance  data  plus  early  warning  informations,  consisting 
of  geometry  and  time  delays.  Various  target  traoke  at  the  beginning  of  the  simulation 
result  in  various  target  and  interceptor  positions  at  ths  missile  launoh  point  or 
detection  point.  These  locations  depsnd  obviously  on  the  early  warning  distance.  Different 
early  warning  zones  result  in  different  interception  zones.  Those  areas  define  the  inter- 
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cept  coordinates  and  thu  position,  altitude,  looking  and  aspect  angles  of  the  opponents 
calculating  all  possible  intruder  courses  and  various  early  warning  distances  the  result 
is  an  early  warning  zone  with  a  corresponding  interception  envelope.  That  means,  GCI  from 
this  airbase  is  on  .y  possible  in  this  particular  interception  area  under  the  condition  of 
certain  early  warning  distances  shown  in  the  early  warning  (EW)  area. 

The  combination  of  the  reeulte  of  separata  airbaaes  in  combination  with  varying  EW- 
distance  and  alert  times  ends  up  in  corresponding  geographical  intercept  lines  which 
demonstrate  how  deep  an  enemy  aircraft  may  penetrate  under  certain  performance  and 
information  assumptions. 

Besides  the  geographic  situation  it  is  of  great  interest  how  many  Interceptors  oan  arrive 
at  a  certain  location  depending  on  EW- information  and  airbase  situation  as  shown  in  Fig.  3 
as  a  function  of  EW,  target  altitude  and  gaographia  coordinates.  The  columns  representing 
possible  number  of  fighter*  are  to  be  considered  ae  excluding  each  other.  Each  column 
represents  one  potential  solution. 

To  show  the  application  of  GCI/CAP  in  the  combined  evaluation  first  let  us  have  a  look  at. 
a  typical  rad  aounter  air  attack  against  targets  in  the  viainity  of  the  western  border  of 
Germany . 

A  rather  big  formation  is  penetrating  over  German  territory.  Fighter  bombers  are  escorted 
by  a  number  of  fighters.  A  stand-off  racetrack  jammer  pattern  ie  established  to  prevent 
early  detection  of  the  formation.  At  the  splitting  point  the  intruders  are  heading  for 
their  targets. 

In  this  example  (Fig.  4)  four  blue  airbases  are  considered  as  fighter  resources  available. 
However,  Neuburg  in  the  south  is  too  far  away.  Wittmund,  Hopsten  and  Pferdafald,  the  re¬ 
maining  interceptor  bases,  are  able  to  meet  tho  threat.  In  this  case  GCI  missions  from 
Hopsten  and  out  of  a  CAP  pattern  deployed  from  Wittmund  are  resulting  in  beam  approaohaa, 
those  from  Pferdafeld  in  a  head-on  attack. 

2.2  Combat  Modelling 

The  GCI-  or  CAP-aalculatione  result  in  a  set  of  geometrical  conditions  together  with  data 
on  fuel  and  detection  serving  as  input  data  for  the  combat  modelB,  especially  tha  m-vs-n 
model  SILKA.  This  model  was  developed  during  the  last  three  years  as  a  common  activity  of 
German  aerospace  industry  and  IABG. 

2.2.1  Assumptions 

The  model  is  based  on  certain  assumptions  (Fig.  5) . 

Two  assumptions  which  drastiaally  effect  the  computers  storage-capability  and  the 
aomputing  time  ara  related  to  time  interval  and  number  of  participating  aircraft. 

Time  interval: 

Based  on  the  experience  of  one-on-one  models  e  time  interval  of  one  second  is  used,  i.e. 
once  per  saoond  the  pilot  makes  a  deaislon  the  aircraft  performance  end  the  geometry  is 
calculated.  Possible  ia  also  a  separate  time  step  for  decisions  (1  second  pilot,  1/10 
second  missile)  and  flightpath  (1  second  aircraft,  1/10  missile);  thia  option  is  in  use. 

Number  of  aircraft: 

Based  on  the  consideration  that  fast  alerting,  take-off  and  guidance  of  many  fighters 
simultanously ,  very  high  take-off  rates,  coordinated  take-off  from  various  air  bases 
seem  to  be  unrealistic  the  number  of  blue  interceptors  was  limited  to  four. 

A  red  attaak  formation  may  consist  of  many  aircraft,  but  it  is  assumed  that  a  segmentation 
is  possible.  In  this  case  not  mors  than  26  aircraft  (any  escort/f ighter-bomber  combination) 
nre  involved  in  the  simulated  part  of  the'  air-to-air  combat. 

The  segmentation  for  example  allows  to  include  escort  fighters  belonging  to  the  following 
formation  if  they  already  detected  the  blue  fighters  or  are  called  in  by  the  engaged  red 
formation. 

Due  to  the  rather  small  number  of  aircraft  a  relatively  detailed  modeling  i*  possible. 
Splitting  the  number  of  engaging  aircraft  and  skillfully  changing  the  position  (for 
example i  result  of  the  first  simulation  «  input  for  the  next  simulation  -  next  blue 
formation  enters  combat)  the  simulation  of  scenarios  with  many  aircraft  can  be  achieved. 

Results i 

The  model  is  deterministic,  for  example,  to  pilot's  decision  and  stochastic  with  respect 
to  detection  and  missile  effectiveness.  Therefore  it  is  necessary  to  run  about  30  -  50 
simulations  (found  by  sensitivity  teats)  for  reliable  statistical  resultB. 

2.2.2  M  versus  N  Allocation 

The  most  difficult  problem  in  m-on-n  air  combat  -  in  reality  as  wall  as  in  the  simulation  - 
is  the  attachment  of  the  participating  aircraft.  This  will  be  explained  in  the  case  of 
three  intruding  red  formations  consisting  of  escorted  fighter-bombers  when  attacked  by 
4  interceptors. 


The  task  is  to  split  up  the  initial  "many  on  many  situation"  into  very  short  "one  versus 
one  combats"  with  changing  opponents.  This  is  possible  by  using  so-called  "active*  and 
"passive"  threat  values  to  allocate  the  aircraft  to  an  attractive  or  threatening  opponent 
(Fig.  6).  Xt  has  to  be  pointed  out  that  the  entire  situation  is  calculated  new  every 
second  and  the  attachment  is  updated  periodically.  That  means  that  the  primary  opponent 
can  change  every  second  if  the  resulting  threat  to  or  from  a  new  hostile  aircraft  is 
greater  than  that  in  the  step  one  second  before.  The  resulting  threat  mainly  aonsists  of 
geometric  and  weapon  threat  (Fig.  7) ■  The  RANGE-THREAT ,  OFF-BORESIGHT-  and  A8RECT-ANGUB- 
thrbat.  The  value  is  ranging  from  0.,  that  is  "no  threat  at  all",  to  1.,  that  is  a 
"deadly  threat". 

Fig.  7  shows  a  possibility  to  define  those  components. 

In  this  example  a  linear  increase  in  range-threat,  was  assumed  from  the  detection  range  R. 
to  the  shooting  distance  R.  and  with  a  smaller  increase  finally  to  a  certain  value  at 
zero  range.  8 

Regarding  the  off-boresight-angle  (OBA) ,  there  is  an  increase  from  180°  to  ip_  that  means 
to  the  max.  OBA  for  a  certain  weapon.  From  now  on  OBA-threat  is  1 . 

The  off-the-tail-angle  (OTA)  threat  is  similar  except  that  there  is  already  a  certain 
amount  at  180°  if  the  weapon  has  all  aspect  capability.  The  dashed  line  ahowa  OTA-threat 
for  a  different  weapon  with  no  front-hemisphere  attack  capability. 

The  variables  RD,  Rg,  tpg  etc.  are  special  data  for  a  certain  missile. 

The  total  threat  is  defined  by  multiplying  those  three  components.  The  resulting  threat 
is  achieved  when  the  tendency  is  calculated,  depending  on  increasing  or  decreasing  threat. 

This  weighting  method  simulates  the  extrapolation  capability  of  the  pilot. 

To  perform  any  type  of  defensive  or  offensive  manoeuvre,  the  pilot  has  to  select  an 
appropriate  opponent.  This  selection  is  made  by  evaluating  the  "threat  matrix". 

Fig.  8  shows  a  closer  look  at  the  blue  threat  matrix  in  that  epeoial  example. 

There  are  4  blue  AD-fightera,  4  escort  and  3  f ightar-bombers  (FB) . 

For  an  offensive  behavior  we  are  considering  the  aotive  threat,  written  in  the  horisontal 
lines. 

Regarding  the  maximum  activa  values  for  the  first  blue  fighter,  we  find  0.8  against  red  3 
and  red  6.  Blue  2  sees  1.0  against  rad  6.  Blue  3  0.7  against  rad  2  and  blue  4  0.6 

against  red  7. 

It  is  sxtremely  important  for  a  pilot  to  astimate  the  threat  from  the  opponents  against 
himself.  We  call  thia  the  passive  threat.  If  it  reaahes  a  value  in  exaeee  of  a  predefined 
threshold,  the  pilot  give*  up  his  aggressiveness  and  performs  a  defensive  manoeuvre. 

The  passive  threat  can  be  read  vertically  in  this  matrix. 

Blue  1  finds  that  of  all  the  rad  A/C,  rad  1  threatens  him  most  of  all.  Blua  2  looks  at 
red  3.  Blue  3  is  anxious  against  red  5,  and  blua  4  against  red  6. 

But  all  the  blue  fightera  have  to  oonaider  that  some  of  the  rad  A/C  may  not  be  visible. 

So  if  we  overlap  the  detection  matrix,  generated  every  second  by  the  aeneor  subroutine!, 
we  see  a  substantial  change  in  the  active  and  paesive  threat  relatione. 

The  model  pilot  as  well  as  the  human  pilot  is  actually  able  to  remember  the  lateat 
position  of  his  target  for  several  seconds.  So  it  is  not  possible  to  "forget"  the  position 
of  the  target  from  one  second  to  the  other. 

As  mentioned  before,  the  threat  values  are  compered  with  certain  predefined  threshold 
values.  These  values  affect  the  decision  of  the  pilot,  and  are  ranging  between  0.  and  1.0 
for  events  ouch  asi 

-  emergency  bomb  release 

-  fighter-bomber  defensive  manoeuvre  with  bombs  on  board 

-  fighter-bomber  defensive  after  offensive 

-  fighter  defensive  after  offensive 

-  secondary  opponent  possible. 

This  last  mentioned  threehold  is  explained  as  follows i 

Usually  a  blue  fighter  has  a  primary  opponent  e.g.  the  red  escort.  It  aould  happen  that 
the  active  threat  against  a  fighter -bomber  is  equal  or  greater  than  the  defined  threshold. 
In  that  case  the  blue  A/C  switahes  to  the  new  target  that  was  originally  of  secondary 
priority. 

Finally  the  splitting  into  1  versus  1  duels  is  achieved.  The  mutual  attachment  of  the  A/C 
of  the  two  parties  la  possible. 

A  very  important  problem  is  the  selection  of  the  proper  weapon.  Fig.  9  shows  that  if  both, 
the  short  range  (SR)  and  medium  range  (MR)  missile  could  be  selected,  the  SR  missile  has 
priority. 

The  maximum  of  medium  and  short  range  missile  threat  is  wsightsd  and  callsd  the  resulting 
threat.  To  select  the  proper  weapon  the  essential  question  lei  Te  a  preselection  defined? 
In  the  case  of  a  semi  active  missile  launched,  succeeding  radar  illumination  of  the 
target  ia  necessary,  After  the  pilot  is  able  to  select  a  new  weapon  due  to  e  new  resulting 
threat, 


2.2.3  Output 

Besides  the  printout  SILKA  data  concerning  air  combat  history  and  missile  events  are 
written  on  tapes  an  input  for  off  line  programs.  Especially  in  the  development  and  test 
phase  of  the  program  plot  and  screen  were  very  useful  tools,  because  failures  and  un¬ 
fortunate  decisions  of  the  model  can  easily  be  located  and  changed. 

The  example  (Fig.  10)  generated  by  the  SILKA  plot  program  shows  the  history  of  a  combat 
of  4  blue  interceptors,  4  red  FB  and  4  red  escort-fighters.  To  achieve  a  sufficient 
combat  time,  the  kill  probability  of  the  missiles  was  artificially  reduced  to  25  4. 

The  initial  phase  of  that  particular  fight  is  shown  on  Fig.  11  demonstrating  the  soreen 
output  on  a  graphic  display.  Around  the  3-dimensional  combat  air  spaae  which  is  possible 
to  be  rotated  around  3  axes,  various  details  of  the  combat  are  visible,  for  example  range, 
OTA,  OBA,  threat  matrix,  attachment  matrix  etc. 

25  seconds  later  the  lower  part  of  Fig.  11  was  taken  from  the  screen.  Demonstrated  is  the 
rotation  of  the  3-dimensional  spaae,  the  flight  history  of  the  surviving  opponents  for  the 
last  ten  seconds,  the  present  geometric  data  and  some  additional  details  of  the  fight. 

2.2.4  Application 

There  are  many  types  of  results  offered  to  be  used  depending  on  the  individual  study 
purpose,  e.g.  missile  specific  trends  or  air  combat  attrition  etc.  In  many  oases,  for 
example  (Fig.  12)  the  launch  geometry  is  an  interesting  result  for  a  missile  designer  as 
well  for  the  operator  as  they  can  be  utilized  to  define  max. /min.  range,  off-boresight- 
and  all-aspect-oapability,  inrange  computation  etc. 

On  the  other  hand  combat  attrition  is  the  most  important  result.  During  first  studies  it 
was  found  out  to  be  very  helpfully  not  only  to  look  at  a  "final  result"  i.e.  result  at  a 
certain  time  limit,  but  also  to  look  on  the  time  history  of  the  engagement  to  get  an 
impression  how  attrition  rates  decrease  or  increase  during  combat  time.  This  is  shown  on 
Fig.  13.  There  is  an  engagement  of  4  A/D-fighters  with  a  threat  consisting  of  4  fighter- 
bombers  escorted  by  4  fighters.  Obviously  the  blue  side  had  a  superiour  armament.  This 
is  shown  by  two  faatsi  First  the  relatively  low  blue  attrition  compared  to  rad  and  snaond 
the  first  launahes  which  correspond  with  the  time  starting  the  red/blue  losses.  This 
combat  ends  with  about  30  4  blue  losses.  If  we  make  the  assumption,  that,  due  to  the  fact 
that  they  are  over  enemy  territory  and  relatively  short  on  fuel,  red  escorts  will  not 
continue  fighting  if  blue  fighterB  want  to  leave  the  arena,  it  is  possible  to  get  a  rather 
different  type  of  interpretation:  If  the  blue  side  would  terminate  the  engagement  at  10  % 
blue  losses  for  example,  they  would  gain  nearly  the  same  escort  losses,  about  70  «  mission 
kill  (compared  to  90  4  in  the  other  case)  and  about  30  *  fighter-bomber  losses  (compared 
to  70  t) . 

That  means  they  may  optimize  their  decision  of  terminating  the  engagement. 

Fig.  14  shows  the  effect  of  force  size:  The  red  forae  has  increased  from  4  PB  +  4  escort 
to  10  FB  +  10  escort.  This  increase  results  in  the  indicated  loss  changes.  Blue  losses 
increase  rapidly  by  about  200  4  while  red  losses,  mainly  the  fighter-bomber  kills  decrease 
in  the  same  percentage.  Again  tho  effect  of  "optimized"  engagement  termination  is  shown: 
After  T  ■  110  sec  red  attrition  only  moderately  increases  while  blue  losses  change  from 
50  %  to  80  4. 

Corresponding  to  attrition  curves  Fig.  15  show  the  missile  consumption,  i.e.  missiles 
fired  and  missiles  lost  that  were  still  on  board  of  shot-down-aircraft .  In  this  case  it 
came  out,  that  in  the  medium  range  case  about  40  4  of  the  missiles  were  fired,  about  20  4 
were  lost  on  board  and  in  the  short  range  area  about  25  4  were  fired,  about  25  4  were 
lost.  Increasing  the  red  force  both  missile  firing  and  losses  increase  rapidly. 

The  next  example  (Fig.  16)  shows  the  effect  of  a  red  stand-off- jammer :  Red  losses  dearease 
by  about  10  4,  blue  losses  increase  from  about  10  4  to  25  4,  i.e.  an  increase  by  a  factor 
of  2.5. 


3.  CONCLUSION 

The  models  now  have  reached  a  first  status  to  be  used  in  production  runs  for  studies. 

Before  application  a  lot  of  tests,  including  sensitivity  tests,  force  size/force  mix  tests, 
missile  and  avionik  specific  tests  (multiple-target  engagement  capability,  various  inrange- 
options,  active/passive  fire  aontrol  etc.)  were  performed.  Furthermore  it  is  planned  to  run 
validation  testB  in  comparison  to  flight  trials  to  increase  the  confidence  level  of  a  very 
new  evaluation  instrument.  Up  to  now  the  program  was  used  for  in  house  purposes  of  the 
German  aviation  industry  and  at  IABG  for  two  missile-speoif io  studies  of  the  Federal 
Ministry  of  Defense  concerning  to-day-missiles,  avionics,  and  next  generation  missile 
concepts . 

It  will  be  used  in  future  air-defense  studies  as  a  flexible  tool  opening  the  possibility 
to  evaluate  the  effectiveness  of  airborne  air-defense  systems  concerning  the  influence  of 
aircraft.,  armament,  avionics,  guidance,  missions  etc.  in  multiple  air-to-air  engagements. 
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THE  MITRE  INTERACTIVE  COMMUNICATIONS  ANALYSIS  PROGRAM  (MICAP) 


John  M.  Ruddy 
The  MITRE  Corporation 
Bedford,  Massachusetts  USA 


f  SUMMARY 

The  MITRE  Interactive  communication!  analyilt  program  (MICAP),  a  uier  oriented  computer  program,  can  provide  complex 
communication!  ayiteni  performance  and  coat  analysis.  The  program  output,  an  "Instantaneous"  graphical  preientation  of  the  data, 
permits  system  synthesis  and  modification  through  rapid  and  easy  system  parameter  Iteration  to  obtain  a  desired  system  performance 
measure . 

Satellite,  airborne,  or  fixed  relay  communications  systems  can  be  analyzed,  Software  development  has  emphasized  satellite  com* 
munlcatlons  systems  analysis  and  synthesis,  the  primary  use, 

MICAP  is  designed  to  be  used  by  communications  system  engineers  through  interaction  with  a  set  of  program  control,  system 
definition,  and  analysis  menus,  which  are  defined  in  a  hierarchical  fashion,  For  example,  the  engineer  can  create  a  satellite  communica¬ 
tions  system  description  by  defining  the  termlnal(s),  satellite(s),  slgnsl  structure,  and  propagation  environment.  The  termlnal(s)  are 
defined  by  their  location,  motion  (If  any),  and  radio  frequency  and  signal  structure  parameters.  The  terminals  can  be  fixed,  airborne, 
or  shlpborne,  The  satelllte(s)  are  defined  by  their  orbit(s),  and  transponder  radio  frequency  and  signal  structure  parameters.  On-board 
signal  processing  as  welt  as  translating  repeater  satellite  transponders  uan  be  analyzed, 

The  paper  describes  the  program  structure  and  capabilities,  which  in  uddition  to  the  above,  include  cost/pcrformuncc  tradeoff 
analysis.  Examples  of  modeling  and  prediction  of  satellite  communication  performance  are  presented.  Applications  to  cost/pcrformuncc 
tradeoffs  and  evaluation  of  architectural  alternatives  arc  discussed. 


INTRODUCTION 

Tile  MITRE  Interactive  communications  analysis  program  (MICAP)  is  being  developed  to  provide  satellite  communications  system 
engineers  with  a  convenient,  easy-to-use,  system  analysis  and  synthesis  toot,  The  primary  driving  forces  in  this  effort  are  threefold. 

First,  there  Is  s  need  to  upprouch  the  satellite  system  engineering  process  wltlt  a  holistic  viewpoint.  That  is,  the  space  segment 
(satellites)  und  the  terminal  segment  (earth  stations)  should  be  treated  together  In  order  to  define  cost-effective  systems.  Tills  leuds  to 
the  second  consideration,  namely,  the  need  far  Including  the  system  cost  in  performing  system  analyses,  comparisons,  und  tradeoffs,  . 
Finally,  there  Is  a  very  rcul  need  for  fust  response  In  system  unutysts  in  order  to  meet  schedule  demands, 

MICAP  is  a  user  oriented  Interactive  program  which  is  eupablc  of  complex  system  performance  and  cost  unslysls.  The  nature  of 
the  program  output,  graphical  presentation  of  the  data  In  the  form  of  coverage  maps  and  performance  curves,  also  permits  system 
synthesis  to  occur,  This  Is  accomplished  by  means  of  rapid  Iteration  of  system  parameters  In  order  lo  obtain  u  desired  system  perform¬ 
ance  capability.  Although  MICAP  is  alio  cupuble  of  analyzing  airborne  und  ground  fixed  relay  communications  systems,  the  primury 
software  development  has  been  focused  on  satellite  communications  system  performance  and  cost  unalysis, 

MICAP  Iras  been  specifically  designed  for  use  by  communications  system  engineers  through  Interact  ion  with  u  set  of  program  control, 
system  definition,  und  system  performance  und  cost  unalysis  menus,  which  are  defined  In  u  hierarchical  fttsltlott,  The  engineer  cun 
creute  a  satellite  communication  system  description  by  defining  the  tcrminul(s),  satcllltc(s).  signal  structure,  mid  propagation  environ¬ 
ment  In  engineering  lorniN.  MICAP  then  provides,  for  a  specified  time  or  lime  Intervul,  system  geometry  lectors,  such  as  satellite 
ground  truck,  visibility  contours,  und  elevation  und  azimuth  angle  from  u  specified  terminul  locution.  Muny  of  these  geometry  factors 
cun  be  associated  with  a  vurloty  of  map  projections  which  arc  selectable  by  the  engineer,  Performance  analysis  parameters,  such  us  time 
deluy,  slgnal-to-'V.nse  ratio,  Rcuinp,  Doppler,  data  rate,  or  system  link  murgln  cun  be  provided  us  a  function  of  time,  Any  of  the  per¬ 
formance  unulysis  parameters  cun  be  plotted  on  u  map  projection  us  u  constant  performance  contour.  For  example,  contours  of  constant 
signal-to-nnlse  ratio  (e.g.,  10  dB,  15  dB,  20  dB)  could  be  plotted  on  a  cylindrical  equidistant  map  projection  of  Europe  for  u  specified 
satellite  system,  In  addition  lo  performance  unulysis,  MICAP  can  perforin  rudimentary  terminul  cost  analysis  und  tradeoffs.  The 
satellite  und  overall  system  cost  unalysis  uupubllltlei  Ituvc  not  yet  been  installed  In  MICAP. 

This  paper  describes  the  overall  MICAP  software  structure  und  anulysls  capability,  A  brief  example  of  system  modeling  and  pre- 
'  diction  of  satellite  communications  performance  Is  Included  to  Illustrate  the  MICAP  structure  and  capabilities, 


MICAP  SOFTWARE  STRUCTURE 

MICAP  software  has  been  developed  with  user  needs  and  convenience  high  on  the  list  of  priorities,  The  user  Interacts  with  the 
system  by  silting  at  a  graphics  terminal  and  communicating  with  MICAP  through  the  keybourd  us  In  figure  1 .  All  communications  are 
presented  on  the  screen  In  alphanumeric!  and/or  graphics,  The  graphics  terminul  used  In  the  present  Implementation  Is  a  Tektionix  4014 
configuration, 

In  addition  to  the  terminal,  there  Is  u  Tektronix  403 1  Hardcopy  Unit  ami  4V23  Digital  Cartridge  Tupe  Recorder.  The  terminal  is 
connected  via  hard  wired  modoms  (4800  baud)  to  the  MITRE,  Corporation's  IBM  Model  3031  central  processing  unit  (CPU),  which  has 
approximately  six  million  bytes  of  storage,  In  addition,  approximately  2400  million  bytes  of  memory  ure  available  through  the  me  of 
on-line  disk  drives,  MICAP  comprises  approximately  40,000  lines  of  code  und  utilizes  up  lo  one  million  bytes  of  muln  memory,  Opera¬ 
tion  Is  on-line  using  the  general  purpose  Interactive  Time  Sharing  Option  (TSO)  of  IBM's  Multiple  Virtual  Storage  (MVS)  operating 
■ysteni. 


M1CAP  software,  which  has  been  coded  In  PlL/I,  is  interactive,  non-real  time  and  menu  driven.  It  has  been  designed  in  a  hierarchical 
fashion.  This  hierarchical  approach,  with  predetermined  software  interfaces  between  the  control  program  and  other  program  options, 
permits  the  easy  addition  of  new  capabilities.  This  is  shown  representatively  in  figure  2.  The  user  Interacts  with  MtCAP  using  the  key¬ 
board  to  access  the  control  menu  option.  There  are  four  basic  types  of  menu  option:  (I)  the  control  option  menu,  (2)  file  option  menu 
(permanent  and  temporary),  (3)  display  control  option  menu,  and  (4)  computational  or  analysis  option  menus. 

M1CAP  Is  designed  to  Interact  with  a  set  of  program  control  menus  which  are  defined  in  a  hierarchical  fashion  (tree  structure). 

The  top  level  tree  Is  shown  in  figure  3.  The  default  file,  display  parameter  options,  environment  perimeter  option,  and  link  parameter 
option  are  used  to  initialize  the  aystem  parameter!  and  condltloui.  The  antiyaii  parameter  option  contains  the  various  analysis  and 
computational  auboptlons  which  Interface  with  the  other  optiona  in  order  to  perform  the  apecifled  analysis  routines,  The  user  accesses 
the  appropriate  option  by  selecting  one  of  the  numbers  associated  with  that, option,  as  shown  in  figure  4,  Figure  4  (which  corre¬ 
sponds  to  figure, 3)  is  exactly  what  the  user  sees  on  the  graphici  terminal  scriten  When  the  MICAP  program  is  loaded.  Figure  4  and  other 
similar  figures  In, this  paper  are  hard  copies  of  what  appears  on  the  graphici  terminal  screen.  They  are  obtained  through  the  uae  of  an 
attached  Tektronix  hard  copy  unit.  A  discussion  of  the  various  option  and  suboptiona  and  their  implications  foliowi. 

,  Figure  5  represents  the  next  level  down  of  the  default  flic,  display  parameters,  and  environment  parameters  option  menus, 

DEFAULT  FILE 

The  default  file  permits  storage  of  parameters  required  to  Initialize  u  particular  problem.  Thus,  the  user  needs  to  enter  the  data  in 
the  relevant  menus  only  once.  The  set  of  completed  menus  is  entered  into  a  designated  file  by  name.  The  entire  file  may  then  be  re¬ 
called  and  modified,  us  necessary,  during  subsequent  sessions  with  the  terminal. 

DISPLAY  PARAMETERS  &  OPTIONS 

This  menu  (figure  6)  permits  one  to:  (a))  set  up  3-dimcnsional  displays,  such  as  the  cost  graphs;  (b)  drive  a  remote  drum  plotter 
ruthcr  than  use  the  hurd  copy  unit;  or  (c)  obtain  a  listing  of  the  tubular  dutu  points  used  to  generate  any  of  the  graphical  displays  (plot 
data  edit  option),  The  zero  Indicates  that  an 'option  Is  not  being  used,  whereas  a  one  Indicates  that  it  Is.  All  graphs  and  plots  ure  auto¬ 
matically  sealed  and  labeled, 

ENVIRONMENT  PARAMETERS  &  OPTIONS 

This  menu  (figure  7)  Is  used  to  describe  tin-  orbit  dynamics  environment  and  radio  frequency  (RE)  signal  environment. 

•  Dynamical 

Tile  orbit  programs  Include  the  capability  to  handle  u  non-spherlcul  eurth  geopotential  up  to  the  J2  term.  They  do  not  yet  bundle 
on-line,  luni-sobir  perturbations,  but  this  cun  be  accomplished  with  an  extensive  off-line  capability. 

RF 

Ground  noise  cun  he  specified  by  (lie  user  und  Included  in  the  computation  of  satellite  guln-to  nolse  temperature  ratio  (G/T).  The 
effect  of  dry  atmosphere  on  signal  attenuation  and  noise  temperature  Is  Included,  using  the  so-called  Dutton  model,  The  effect  of  ruin 
attenuation  bus  not  yet  been  Included,  Solar  noise  is  included  by  treating  the  sun  us  a  bluckbody  radiator  and  computing  its  effect  on 
system  noise  temperature  when  the  sun  Is  in  un  antenna's  field  of  view,  The  run's  cmphomorls  is  computed  us  u  function  of  time, 
Cosmic  noise  effects  muy  slso  be  included. 

Figure  8  represents  the  nuxl  lower  level  of  the  link  purumeters  &  option  menu  und  the  analysis  parameters  &  options 
menu. 

LINK  PARAMETERS  41  OPTIONS 

The  menu  shown  in  figure  *>  is  used  to  define  the  system  parameters  for  the  particular  communications  problem  being  unuly/.cd. 
Antennu  Pattern  Flje  f' 

This  menu  permits  the  creation  uml  use  of  3-dimcnslonul antennu guln  patterns  based  upon  measured  or  computed  dutu.  As  un  example, 
u  2 -dimensional  polar  plot  of  u  rotutlonully  symmetric  pattern  Is  shown  In  figure  10  This  Is  the  uctuul  Defense  Satellite  Communica¬ 
tions  System  (DSCS)  It  ureu  coverage  receive  antenna  pattern,  us  measured.  This  file  Is  used  when  mathematical  representation  of  a 
parabolic  or  helix  antennu  is  not  appropriate. 

lU?-*  File 

This  menu  permits  the  use  of  uetuul  transponder  gain  characteristics,  rclutlve  to  maximum  repealer  transmit  power,  In  un  end-to- 
end  link  computation,  The  DSCS  II  channel  2  transponder  guln  Is  shown  In  figure  1 1  The  transponder  guln  Includes  the  nominal 
uplink  untcniui  gain  uml  Is  relative  to  the  output  transmitter  power  level  snoelfled, 

Terndnu!  (Number) 

These  menus  arc  used  lo  describe  locution,  dynamical  behavior,  und  RE  parameters  of  up  k>  1  f>  let., hauls  In  u  manner  which  then 
cun  be  used  directly  by  the  various  analysis  routines.  II, samples  of  completed  menus  me  shown  In  figures  I  2.  1 3.  and  14,  flic  upper 
bound  of  In  terminals  is  arbitrary  and  c.m  be  increased  If  necessary. 


Terminal  Parameter!.  Used  to  name  terminal,  Indicate  whether  terminal  ii  to  be  included  ( I )  or  not  included  (0)  in  analyiii,  and 
to  go  further  down  menu  hierarchy , 

/ 

Terminal  Location  4  Mptjonjtormeters.  Used  to  fully  describe  the  terminal  location  and  motion  at  a  specified  time  (epoch)./ 

Terminal  RF  Options  4  Parameters.  Used  to  describe  RF  transmit  and  receive  channels  for  terminal  as  welhai  modulation  type. 

The  program  permits;  (a)  traveling  wave  tube  (TWT)  backoff  in  case  of  multi-carrier  oporation;  (b)  Doppler  tracking  if  i!$*ired; 

(c)  terminal  antenna  tracking  or  fixed  pointing  direction  with  the  two  pointing  angles  (azimuth  and  elevation)  defined  by  the  user; 

(d)  use  of  an  analytically  computed  parabolic  dish  antenna  pattern,  a  helix  antenna  pattern,  or  a  table  look  up  (antenna  pattern  file); 

(c)  choice  of  either  analog  (I)  or  digital  (2)  modulation  class,  phase  or  frequency  coherent  or  non-coherent  (1 , 2, 3, 4)  type,  and  2-ary, 
4-ary,  etc.  (2, 4, . , .)  order.  The  program  also  allows  the  user  to  specify  the  overall  system  receive  noise  temperature  or  permit  compu¬ 
tation  of  system  receive  noise  temperature  using  the  actual  or  specified  receiver  chain  noise  temperatures,  gains,  and  line  losses, 

interlink  (Number) 

These  menus  describe  up  to  16  relay  platform  locations  and  their  dynamical  behavior  (l,e„  orbit  or  fllghtpath),  type  of  repeater, 
and  RF  parameters  in  a  manner  which  is  directly  usable  by  the  various  analysis  routines.  Examples  of  the  menus  nnd  sample  data  are 
shown  in  figures  IS,  16,  and  17.  Again  the  upper  bound  of  16  Interlinks  It  arbitrary  and  may  be  increased. 

Interlink  Ojiho^&Parameters.  (figure  iS)  Used  to  name  Interlink  or  relay  (satellite,  aircraft  or  fixed);  Indicates  whether  inter¬ 
link  is  tolTe~[ncluded  in  analyses,  whether  Interlink  is  satellite  or  airborne  relay  (fixed),  whether  interlink  repeater  is  a  transponder  type 
(translating)  or  regenerates  signal  (the  transplexer  option  is  not  yet  defined);  defines  transponder  channel  gain;  and  permits  access  to 
lo'  ,  •  levels  of  menu. 

Airborne,  Permits  definition  of  locution  and  motion  parameters  associated  with  the  relay  platform  in  a  manner  similar  to  menu 
shownTn  figure  13, 

Orbital  Parameters,  (figure  16)  Permits  complete  description  of  orbit  with  respect  to  a  specified  epoch,  which  in  our  case  Is 
referenced  to  the  1 950  epoch  January  0,0  Thu  epoch  line  defines  time  of  perigee, 

Interlink  RF  Options  4  Parameters.  Same  definitions  us  for  the  terminal  RF  options  4  parameters  (l.e,,  ‘'mirror"  Image)  in 
figure  I?! -  - - 

ANALYSIS  PARAMETERS  4  OPTIONS 

Thu  top  level  menu  for  this  portion  of  the  program  is  shown  in  figure  IS,  The  first  three  lines  (I  to  3)urc  used  to  set  the  time 
period  over  which  solutions  are  desired,  Thus,  there  is  a  start  time,  a  stop  time,  and  the  time  steps  for  the  solution  desired.  One  may 
examine  u  problem  over  any  time  interval  desired  with  as  fine  grain  time  resolution  as  deemed  necessary.  Setting  equal  start  and  stop 
times  provides  a  single  time  solution. 

CalondarFunctions 

Tills  menu  Is  used  to  define  universal  time  epoch  in  Julian  days,  hours,  minutes,  and  seconds,  given  east  longitude  and  locul  mean 
solar  time.  The  epoch  is  referenced  to  1950  January  0.0. 

PorformanccFnutors 

Tills  menu  is  used  to  Include  the  degradation  effect  on  signal-to-nolse  when  multiple  terminals  use  the  same  satellite  transponder 
chunncl. 

M  apOptlqns  4  .Parameters 

This  menu  (figure  19)  permits  selection  of  mup  coordinates;  cylindrical  equidistant  (figures  20, 21),  orthographic  (figure  22),  or 
polur;  whether  u  map  of  the  world,  CONUS,  or  none  Is  desired;  the  viewing  point  in  tormi  of  latitude,  east  longitude,  orientation  angle, 
and  altitude;  the  size  of  map  with  respect  to  terminal  screen;  the  latitude  and  longitude  grid  tesolutlon;  and  whether  terminal  site*  should 
be  delineated  by  a  trlungulur  cursor.  Any  of  tlte  map  projections  can  be  used  in  conjunction  with  the  appropriate  system  geometry  and 
performance  analysis  routines. 

System  Qconietry  Parameters  4  Options 

This  menu  (figure  23)  providen  access  to  system  geometry  options, 

(f^ure  24)  Provides  u  view  of  the  orbit  over  the  specified  time  interval  us  viewed  from  an  earth  fixed  point. 

The  figure  shows  three  1 2-hour  elliptic  orbits  (64.3°  inclination)  plus  two  24-hour  (2°  inclination)  orbits,  Note  that  the  observer  is  at 
an  earth  fixed  point  locuted  above  45°  N  h»t.  and  -10°  E  lut,  at  an  altitude  of  300,000  km.  The  apparent  path  of  the  satellites  is  shown 
for  a  24-hour  period, 

liitcrlink  G^oundjrrugkj  (figure  25)  Provides  a  view  of  the  subsateliite  trace  as  a  function  of  time,  This  could  be  on  sny  of  the 
throe  projections  asuTcouTd  be  an  airborne  repeater  "subiatellltc"  truce  as  well,  The  figure  is  for  the  same  orbit  as  in  figure  24.  The 
granularity  through  perigee  Is  dut  io  10-mlnute  step  time. 

Interlink  Shadow  Ground  Truck,  Provides  a  truck  of  the  solar  "slwdow"  cast  by  the  repeater  clement  as  u  function  of  time,  This 
can  he  an  impoi  tant  consideration  for  millimeter  wavelength  communications  links. 


Site  Penetration,  (figures  26,  27)  Provides  (for  any  uplink  or  downlink  terminal)  an  elevation  angle  history  (figure  26)  or  azimuth/ 
elevation  angle  history  (figure  27)  of  the  satellite(s).  The  center  of  the  azimuth/elevation  plot  is  zenith,  the  top  of  the  plot  Is  north,  and 
the  concentric  circles  and  radial  lines  are  30°  apart.  Thus,  the  outer  circumference  represents  the  nadir.  These  figures  are  for  the  same 
satellites  as  in  figure  24. 

Terminal  Ground  Track,  Provides  a  ground  traok  as  a  funotion  of  time  for  moving  terminals  on  map  projection  of  choice. 

Ground  Coverage  Pattern.  Provides  contours  of  constant  elevation  angle  for  a  fixed  time  or  for  a  series  of  time  points  on  a  map 
projection  of  choice,  all  operator  selectable.  Figure  28  shows  the  1°  and  20°  elevation  angle  contours  for  the  four  DSCS II  satellites  in 
their  nominal  locations, 


Interlink  Look  Angle,  Provides  angular  separation  for  two  points  located  on  the  earth's  surface,  as  viewed  from  any  satellites  or 
aircraft,  as  a  /Unction  of  time, 


Sun  and  Moon  Ephemtrls,  Provides  azimuth  end  elevation  angles  at  a  function  of  time  for  sun  or  moon,  given  epoch. 
Performance  Analysis  Parameters  A  Options 


This  menu  (figure  29)  permits  the  user  to  select  which  link  performance  parameters  he  withes  to  analyze. 


Performance  Select,  With  this  menu  and  selection  of  an  uplink  and  downlink  terminal  pair,  the  user  can  evaluate:  (a)  up,  down, 
end-to-end  time  delay  (assumes  zero  processing  time  In  repeater),  (b)  up,  down,  end-to-end  slgnat-to-nolse  ratio  (SNR),  (c)  Rco_- for 
the  specified  channel;  e,g„  linear  repeater,  hard  decision  processing  (HDP),  soft  decision  processing  (SDP),  and  decode-recode  (DEP) 
processing,  for  M-ary  orthogonal  modulations,  (d)  DRcornp,  the  difference  in  channel  performance  between  HDP,  SDP  or  DEP  and  the 
linear  repeater,  (e)  probability  of  error  bound  associated  with  R?omp,  (f)  up,  down,  end-to-end  Doppler,  (g)  up,  down,  end-to-end 
energy -to, noise  ratio  (ENR)  for  a  specified  data  rate,  (h)  probability  of  error  given  modulation,  data  rate,  and  deitred  margin,  (1>  data 
rate  given  desired  probability  of  error,  modulation,  and  margin,  and  (j)  margin  given  data  rate,  modulation,  and  probability  of  error. 


Antenna  Putter n  Footprint,  (figure  30)  Provides  satellite  antenna  pattern  footprint  on  map  projection  of  choice,  antenna  pointing 
directionof  choice,  and  gain  oontrous  of  choice,  in  this  case  the  area  coverage  receive  footprint  pattern  (uotual)  of  the  DSCS  11 
Atlantic  satellite  is  shown  with  -6,  -4,  -2, 0  dB  relative  gain  contoura. 


A*J.t«niia_Sk>y>rlnt .  Provides  terminal  antenna  pattern  “skyprint"  on  elevation/azimuth  polar  plot,  for  antenna  pointing  of  choice, 
and  gain  contours  of  choice. 

Performance  Function  Footprint,  (figure  3 1 )  Provides  contours  of  conitunt  time  delay,  SNR,  Rcomp,  Doppler,  ENR,  probability 
of  error,  data  rate,  and  margin  on  map  projection  of  choice  with  contoura  of  choice.  Figure  3 1  illustrates  contours  of  constant  data 
rate  for  DSCS  II  for  u  specific  channel  siate,  modulation,  and  bit  error  rate,  Any  of  the  performance  measures  can  be  plotted  In  tills 
fashion. 

Cost  Analysis  Parameters  A  Options 

Tills  menu  (figure  32)  permits  selection  of  various  submenus  in  the  cost  analysis  section.  At  present  tills  section  can  set  up  cost 
data  files,  extract  cost  estimating  relationships  (CERs)  for  terminals,  and  examine  cost/pcrformance  Interrelationships  for  terminals, 

Cost  Duta  File.  Permits  user  to  read  in  extant  files,  dofine  new  flies,  rovluw  existing  files,  and  extract  any  one  of  three  forms  of 
CER  against  the  sumplo  data.  An  example  of  a  low  noise  amplifier  cost  file  Is  shown  In  figure  33.  The  three  forms  of  CER  In  use  at 
prosent  ure  shown  In  figure  34  and  a  sample  CER  extraction  (form  #3)  for  the  low  noise  amplifiers  is  shown  in  figure  35. 

TermlnaJ  Pamneters  ^Options.  Permits  examination  of  the  cost  variation  of  u  terminal  as  different  engineering  parameters  are 
allowocTtb'vury  dvoTprcsb't  ra"nges.'~An  automatic  scureh  through  this  multi-dlmensionul  cost  space  can  be  made  to  ascertain  the  lowest 
relative  cost  terminal  configuration.  An  example  of  a  3-dlmensionul  cost  sensitivity  analysis  is  shown  In  figure  36.  Tills  v;as  done  using 
u  specific  terminal  cost  model  and  terminal  configuration.  The  unieitnu  size  wcb  two  meters  and  the  operating  frequency  was  8  CiHz. 
The  cost  represents  only  tile  RF  portion  of  the  terminal.  The  sensitivity  to  low  noise  temperature  ruthor  titan  transmit  power  level  Is 
appurent  In  the  region  of  approximately  200°K, 


EXAMPLE 

An  example  based  on  an  actual  problem  statement  provides  a  brief  exposition  of  the  analysis  capability  of  M1CAP.  It  was  desired 
to  have  u  knowledge  of  whore  a  ground  mobile  force  (GMF)  terminal  could  be  located  in  Europe  so  that  It  could  support  either  six  or 
twelve  48  kbps  digital  telephone  circuits  buck  to  Washington,  D.C.  Tlio  GMF  terminal  is  the  TSC-94  whose  RF  parameters  ure  presented 
In  figure  1 4,  The  Washington,  D.C.  terminal  Is  an  FSC-78  whose  RF  parameters  ure  presented  In  figure  37.  The  satellite  used  is  the 
Atlantic  DSCS  II  located  at  12.5°W  whose  RF  parameters  arc  presented  In  figure  17.  Other  constraints  were  the  use  of  channel  2 
which  Implies  the  use  of  the  nrou  coverage  receive  untomut  (pointed  us  shown  in  figure  30)  and  the  earth  coverage  transmit  antenna. 

The  transponder  gain  state  was  specified  to  be  -1 2  dB  and  the  modulation  was  selected  us  tmeoded  QPSK.  A  bit  error  rate  of  10"*  und 
a  system  margin  of  4  dB  had  to  bo  maintained.  The  basic  result  wub  presented  In  figure  31 ,  which  indicates  two  contours  of  constant 
performance  far  the  conditions  specified.  The  288  kbps  contour  uncloses  un  area  where  at  leasl  six  telephone  circuits  could  be  sus¬ 
tained  und  the  576  kbps  contour  encloses  un  area  where  the  twelve  telephone  circuits  could  be  sustained,  This  entire  computation 
Including  logon,  menu  completion,  and  analysis  was  accomplished  In  less  tliun  one  hour  of  connect  time  und  less  than  300  seconds  of 
CPU  timol  The  answer  to  the  question  Is  provided  In  u  form  precisely  us  required  by  the  system  engineer,  und  includes  the  effects  of 
atmospheric  attenuation  und  till  differential.  If  syslcm  changes,  such  a:,  modulation  changes,  different  transponder  loadings,  etc.,  are 
desired,  they  can  be  entered  as  simple  modifications  to  the  various  menus  whore  appropriate.  The  now  results  can  be  very  quickly 
ascertained.  Thus,  by  Iterating  over  u  range  of  system  alterations,  system  synthesis  occurs.  When  the  effects  on  terminal  costs  ure 
Included,  a  preliminary  Indication  of  cost/pcrformuncc  tradeoffs  can  be  provided,  MICAP  thus  permits  engineering  design  synthesis 
and  analysis  to  occur  where  previously  tltc  sheer  magnitude  of  the  effort  would  be  prohibitive. 


CONCLUSIONS 


MICAP  provides  rapid,  repeatable,  and  accurate  communications  system  unalysls/synthesis  results  for  a  wide  range  of  so  :ellite  (or 
airborne  or  ground  fixed)  system  problems,  Key  questions  concerning  system  geometry  and  RF  (electrical)  performance  can  be 
answered  easily  And  swiftly  without  recourse  to  large  amounts  of  manpower,  Due  to  tne  interactive  and  graphical  nature  of  the  proyram, 
effective  aystem  synthesis  can  be  accomplished  through  systematic  Iterations  of  system  parameters.  Comparisons  of  performance 
effectiveness  within  a  wide  range  of  communication!  system  alternatives  can  be  made  quickly,  The  ability  to  perform  top  level  satellite 
system  performance/cost  tradeoffi  requires  further  development  and  refinement  pf  satellite  and  related  life  cycle  cost  eitlmating 
algorithms.  When  complete,  these  algorithms  will  be  simple  to  install  because  of  the  modular  nature  of  the  software,  MICAP  will  not 
replace  detailed  system  design  efforts.  Its  primary  purpose  and  utility  is  to  develop  a  small  number  of  reasonable  alternatives  which 
would  be  then  subjected  to  unalysla  In  greater  depth. 
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DISPLAY  PARAMETERS  4  OPTIONS 


0  NO  CHANGE 
1  V  AXIS  ANGLE  (DEG) 
a  2  TO  X  RATIO 

3  V  DIRECTION  LINES  OPTION 

4  FLOATING  PLOT  OPTION 

6  X-V  AXES  INTERCHANGE  OPTION 

6  CALCOHP  PLOT  OPTION 

7  PLOT  DATA  EDIT  OPTION 
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Fig, 6  Display  control  menu 

ENVIRONMENT  PARAMETERS  l  OPTIONS 
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Fig, 7  Jinvlronment  definition  menu 
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Fig  .8  Lower  level  program  control  structure  (partial) 
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LINK  PARAMETERS  L  OPTIONS 
8  DESELECT 

1  ANTENNA  PATTERN  FILE  ANTD2RA 

8  AMPLIFIER  TRANSFER  CHAR  FILE  AMPD2A2E 
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4  INTERLINK  (NUMBER) 

5  COST  LINK  (Kt) 
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Fig, 9  Top  level  link  definition  menu 
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Flg.l  1  DSCS  II  Channel  2  transponder  characteristic 


TERMINAL  PARAMETERS 


0  NO  CHANGE 

1  NAME  TSC-94 

8  ENAILEMENT  INDICATOR  1 

3  FIXED/MOBILE  OPTION  O 

A  RF  PARAMETERS  &  OPTIONS 
6  COST  303 


MAKE  ANV  CHANGE t 

Fig.  12  Terminal  definition  menu 


TERMINAL  LOCATION  fc  MOTION  PARAMETERS 


•  NO  CHANGE 

1  LOCATION  LANDSTUHL 

8  GEODETIC  LATITUDE  (DEG )  49.40 

3  EAST  LONGITUDE  (DEG)  7. S3 

4  ALTITUDE  (M)  S70 

6  GROUND  SPEED  (M/SEC)  0 

6  HEADING  (DEG)  0.00 

7  EPOCH  (U.T.)  (JD  HRS  MIN  SEC)  O 


0.0 
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Fig.  1 3  Terminal  locutlon/m  jtlon  definition  menu 


TERMINAL  RF  OPTIONS  &  PARAMETERS 


t  NO  CHANQE 

1  TRANSMIT  POUER  (KM)  6.666 

S  NON-LINEAR  OPT  k  BACKOFF  (DB)  S 

3  TRANSMIT  FREQUENCY  (MHZ)  8186 

4  XMT  DOPPLER  TRACK  OPUON  S 

5  TRANSMIT  BANDWIDTH  (KHZ)  1162. S 

6  XMT  ANT  PNT  OPT.  ZD.  AZ  (DEO  S 

7  XMT  PAT  8EL  ( -1/P, -2/8. »3/T )  1 

8  XMT  ANT  DIA.  £FF.  ROUGH  2.4 

9  XMT  FEED  LOSS  (DB)  -S.5 

15  XMT  MODULATION  CLASS  SELECT  2 

11  XMT  MODULATION  TVPE  SELECT  1 

12  XMT  MODULATION  ORDER  SELECT  4 

13  DIPLEXER  OPTION  S 

14  RCU  FREQUENCY  (MHZ)  74SS 

16  RCU  DOPPLER  TRACK  OPTION  0 

16  RECE1UE  BANDWIDTH  (KHZ)  1152. S 

17  RCU  ANT  PNT  OPT.  ZD.  AZ  (DEC)  6 

18  RCU  PAT  SEL  ( -1/P, -8/S, -3/T  )  1 

19  RCU  ANT  DIA.  EFF.  ROUGH  2.4 

2S  RCU  ANTENNA  NOISE  TEMP  (DEG  K  9S.S 

81  RECEIUE  FEED  LOSS  (DB)  -2.6 

22  RCU  AMPLIFIER  GAIN  (DB)  26. S 

83  RCU  AMP  NOISE  TEMP  (DEG  K)  126.6 

24  RECEIUE  LINE  LOSS  (DB)  -6.2 

86  RECEIUER  NOISE  TEMP  (DEG  K)  1566.6 

86  RCU  MODULATION  CLASS  SELECT  2 

27  RCU  MODULATION  TYPE  SELECT  1 

as  RCU  MODULATION  ORDER  SELECT  4 

29  SYSTEM  RECEIUE  TF.MP  (DEG  K)  366.6 


MAKE  ANY  CHANGES 
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Fig.  1 4  Termlnul  RF  parameter  definition  menu  (TSC-94) 
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INTERLINK  OPTIONS  &  PARAMETERS 
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1  NAME  DSCS8  AT 

a  ENABLEMENT  INDICATOR  1 
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6  RF  PARAMETERS  I  OPTIONS 
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MAKE  ANY  CHANGES 
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Fig,  1 5  Interlink  definition  menu  (I)SCS  11,  Channel  2) 
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Fig,  1 6  Orbit  definition  menu  (DSCS  II,  Atlantic) 
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Fig,  17  Interlink  RF  parameter  definition  menu  (DSCS  II,  Channel  2) 
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ANALYSIS  PARAMETERS  &  OPTIONS 
9  DESELECT 
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1  JD  HRS  MIN  SEC 
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Fig.  1 8  Top  level  analysis  control  menu 


MAP  ONLY  PARAMETERS  k  OPTIONS 


9  NO  CHANGE 

1  MAP  COORDINATE  SELECT  8 
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-  a/ORTHOGRAPHIC 

•  3/POLAR 

a  MAP  SELECT  1 

-  9/NO  MAP 
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-  3/CONUS 

3  MAP  GEODETIC  LATITUDE  (DEG)  89.99 

4  MAP  EAST  LONGITUDE  (DEG)  -59.99 

5  MAP  ORIENTATION  ANGLE  (DEG)  89.90 

6  MAP  YIEUING  ALTITUDE  (KM)  899999. S 

7  MAP  RELATIUE  SIZE  1.99 

8  MAP  GRID  OPTION  1 

9  MAP  GRID  LAT  RESOLUTION  (DEG)  IS. 99 

19  MAP  GRID  LON  RESOLUTION  (DEG)  15.99 

11  MAP  TERMINAL  SITE  CURSOR  OPT  1 

13  DISPLAY  MAP 


MAKE  ANY  CHANGE! 


Fig.  1 9  Map  selection  menu 
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Pig, 20  Cylindrical  equidistant  map  projection  (as  viewed  from  1 00,000  km) 


Fig. 21  Cylindrical  equidistant  map  projection  (as  viewed  from  750  km) 


Fl«.22  Orthographic  map  projection  (a*  viewed  from  300,000  km) 


SYSTEM  GEOMETRY  PARAMETERS  l  OPTIONS 
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1  ORBIT  PERSPECTIVE 
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4  SITE  PENETRATION 

5  TERMINAL  GROUND  TRACK 

6  GROUND  COVERAGE  PATTERN 
V  INTERLINK  LOOK  ANGLE 
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9  MOON  EPHEMERIS 
10  WORLD  VIEW 

MAKE  SELECTION t 


Fig, 23  System  geometry  control  menu 


28-18 


«tT"  I 


Ti  . 


QMUN8  COUCEMM  MTTCRN 

S? : ,“**7  J  i  «:• 

TX  •  I44MM  1  «  M 


- •'gjr.-Jtf: 


urn 


« . = . ...ppsri 


i  U<  \  . I-  i 


1  •*••...  L  i  V  I  !  ;  *  L  '  ''J  \ 

A  . tiy  tr.::'uy)i>>'*n •  ■  *J"  . v**.  . v '  '  ■ 1 1 1  ■■ ->  ■/.} . ,*n^  4 

linn  lll.i.g f44  S  '■  ■  ~L  *l  *  *, '.  '  — ~l  .  — T.  'l  I  HM  ,  ,  . . ,  ...jj.'m  -ry^  ‘,*|**.  . 


OVllNMICAL  C9UI»I*TWT 

LAT  -  IN 

LOW  •  *,M 

INC  •  «.M 

ALT  -  IWH 

«>Zt  •  1 1 09 


Fig, 28  Ground  coverage  pattern  (four  DSCS  II  satellites) 


PERFORMANCE  ANALYSIS  PARAMETERS  &  OPTIONS 
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Tig,29  Performance  uttalysis  control  menu 
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COST  ANALYSIS  PARAMETERS  fc  OPTIONS 
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Flg.32  Cost  analysis  control  menu 
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Flg.33  Cost  file  for  low  noise  amplifiers 
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EXTRACT  CER  PARAMETERS  1  OPTIONS 
a  DESELECT 
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Fig.34  CER  extraction  selection  menu 
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Fig.35  Sample  CER  anil  RMS  fit  to  data  (low  noise  amp) 
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Fig. 36  Uplink  terminal  cost  vs  RCV  ampllt'ler  temperature  and  transmit  power 


TERMINAL  RF  OPTIONS  I.  PARAMETERS 


0  NO  CHANQE 
1  TRANSMIT  POWER  <KU) 

8  NON-LINEAR  OPT  I  BACKOFF  (DB) 

3  TRANSMIT  FREQUENCY  (NHZ) 

4  XMT  DOPPLER  TRACK  OPTION 
6  TRANSMIT  BANDWIDTH  (KHZ) 

6  XMT  ANT  PNT  OPT,  ZD,  AZ  (DEG) 
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8  XMT  ANT  DIA,  EFF,  ROUGH 
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18  XMT  MODULATION  ORDER  SELECT 
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13  DIPLEXER  OPTION 
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Fig. 37  FSC-78  terminal  RF  parameters 
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S  UNWARY 

Th*  atudy  of  a  radio- inertial  guidano*  ayatam  vaa  initiated  to  lnoraaia  th*  aoouraoy  of  airoraft 
guidano*  along  tha  US  b««ma  and  to  anaur*  continuation  of  automatio  landing  in  th*  avant  of  a  looallser 
transmitter  fallur*  (rafaranoa  (l)). 

N*w  development*  of  th*  atudy  anaura  a  new  funotlon,  namely  th*  dataotlon  of  davlatlona  of  th*  Loo  baam 
oantarlln*  after  an  undatcatad  fallur*  of  th*  monitoring  of  tha  Loo  axle  alignment  with  th*  runway  ax la, 
in  order  to  aohlava  Category  III  daolalon  height*  on  Category  II  IL3  Beam*. 

A  digital  simulation  atudy  haa  allowed  u*  to  damonatrat*  th*  ayatam  parformanoa.  It  waa  baaad  upon 
dlffarant  Item*  i  firstly  aircraft,  auto-pllet,  Inertial  navigation  ayatam  error,  Loo  baam  perturbation 
modeling  waa  studied,  Later,  after  AIRBUS  A. 300  flight  testa,  th*  simulation  results  ware  compared  to  th* 
flight  test  result*.  Many  automatic  landing  simulation*  have  allowed  u*  to  know  th*  system  posalbllltlaa 
from  th*  probabilistic  point  of  view  with  good  aoouraoy.  Certification  of  tha  eyatem  for  ua*  by  the  Pranoh 
domastlo  airline  AIR  IN1ER  la  In  prograas  with  th*  Branch  Authorities, 

NOTATIONS 

Distance  Measuring  Equipment 
Plight  Management  Computer 
Instrument  lending  Syetem 

Inertial  Navigation  Syetem,  Inertial  Sanaor  Syetem 
Loo  Inertial  Ststlatla  System 
Pilot*  Automatlqu* 

Eosrt  angulalr*  do  l' avion  par  rapport  A  l'axe  plat*  mesurd  reapeotlvsment  eetimd,  vral 
Eoart  mdtriqu*  d*  l'avlon  par  rapport  A  l'axe  plate  meaurd  reapaotlvement  eatimd,  vra.i 
Signal  gild*  meaurd 
Altituda  radlo-altlmAtr* 

Compoaantea  de  la  vitaaa*  Nord  vrala,  raapectlvament  indlquda,  erreur  d*  vlteaae,  ddriv*  avao 
1*  tempi 

Compoaantea  d*  la  vitaaa*  Eat  vrele,  respeotivement  lndlqude,  erreur  dt  vlteeae,  ddriv*  aveo 
1*  temp* 

Cofipoaantae  d*  la  vlteaae  transveraal*  vrale,  reapectlvement  lndlqude,  errwur  d*  vlteaae, 
ddriv*  aveo  1*  temp* 

Route,  route  lndlqude  par  la  oentral*  Inertlell* 

Rout*  d*  rdfdreno*  pour  la  projection  dee  viteseea  inertlell** 

Eoart  angulalr*  antra  l'axe  moyen  du  falaoeau  Loc  *t  la  rdfdreno*  da  projection  da*  vlteeae*  Rf 
Ddoalag*  angulalr*  du  falaoeau  Loo 
Cap  gdographiqu*  d*  la  plat* 

Senaibllitd  d*  l'doart  Loo  (  an  fj A/rd) 

Dlatano*  de  l'avlon  par  rapport  A  l'dmetteur  Loo,  au  seull  dt  plate 

Campoeentea  d*  la  vlteaae  angulalr*  d*  l'avlon  *n  roulle  «t  laoet  dans  lea  axes  d*  stability 
(indiot,  a)  at  dans  lea  axea  avion  (Indio*  ]) 

Ddrapage  adrodynamlque  *t  par  rapport  au  aol 
Braquagea  dee  gouvernea  da  gauohleaement  *t  d*  direction 
Veoteur  d'dtat  du  flltr*  d*  Kalman  rdel,  puia  estimd 
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Palro  >  ptol  1 


y ,  u  t  Vsateur  da  maaura  (  Y  -  HX  +  W) ,  veotaur  d'entrda  du  aystkma 
£  i  Metric*  da  oovarianoa  daa  arraura  d'eatiidstlon  (  X  -  X) 


1  ■ 

L' Melioration  du  guidaga  d'un  avion  an  approoha  finala  par  1' utilisation  da  tensas  inartiala  a  dd- 
Jk  fait  l'objat  da  nombrauaaa  dtudas  afln  da  rddulra  laa  minima  da  vlalbllltd  lnposds  par  la  natura  daa 
dqulpamanta  au  aol  (ILS),  c'aat  V  l'inatlgation  da  la  oompagnit  adrianna  intdrlaura  franqalaa  AIR  INTER 
qu'una  dtuda  a  dtd  antrapriaa  an  1975,  noun  oontraot  daa  aarvloaa  offioiala,  par  la  aooldtd  AEROSPATIALE 
an  oollaboratlon  av«o  la  aooldtd  3A0EM, 

Laa  objaotlfa  lnltlaux  dtalant  laa  aulvanta  i 

a)  Plltrajs  daa  informations  LOCALIZER  (LOG)  afln  d'obtanlr  la  rdduotlon  daa  doarta  da  trajaotolra 
latdrala,  daa  mouvamanta  da  roulla  at  laoat  at  daa  agitations  daa  gouvamsa. 

b)  Survla  du  guidaga  k  una  panna  da  l'dmattaur  LOC  k  baaaa  altituda,  an  partleullar  da  100  ft  Juaqu' 
k  l'lmpaot  sur  daa  installations  ILS  da  oatagorla  II  ou  III, 

La  aystkma  mis  au  point  k  partlr  da  oaa  daux  objaotlfa  a  dtd  prdaantd  k  la  oonfdranoa  AQARD/OOP  da 
Stuttgart  an  mai  1977  (rdf  (i))  at  a  dtd  asaayd  an  vol  sur  1' AIRBUS  n*  3  an  1977%  Cepandar.t,  pour. ,1a  oartl- 
floatlon  du  aystkma  avao  daa  minima  da  oatdgoria  III  alora  qua  l1 ILS  n'aat  qua  da  oatdgoria  II,  laa  aar¬ 
vloaa  offioiala  franyaia  ont  damandd  qua  la  aystkma  LOC  Inartlal  LISS  rdponda  k  un  Jk  objaotif  pour  palllar 
la  manqua  da  aurvalllanoa  daa  LOC  da  oatdgoria  II,  k  savolr  i 

o)  Ddtaotion  d'un  falaoaau  LOC  an  moyanno  ddoald  da  l'axa  rdal  da  la  Plata,  k  la  aulta  d'una  panna 
non  ddtaotda  du  monitaur  da  aurvalllanoa  da  1'ILS. 

La  systkma  prdaantd  lol  parmat  da  rdpondra  k  oatta  nouvalla  damanda  sous  oartalnaa  conditions.  La 
ddtarmlnatlon  at  la  validation  das  parformanoaa  du  aystkma  an  vus  da  son  aooaptatlon  par  laa  aarvloaa  of¬ 
fioiala  furant  fonddaa  an  granda  partis  aur  las  dtudas  an  simulation  numdrlqua  at  o'aat  oat  aspaot  plus 
partlauliar  qua  noua  allona  ddvaloppar, 

s  -  aasiffi  wjumaum 

8.1  maatet  graftal 

La  systkma  da  guidaga  hyorida  radio- lnartial  LISS  ast  urvoaloulataur  qui  a'inakra  antra  las  rdosptaurs 
radio  at  la  pllota  automatiqu*.  11  foumlt  au  P,A,  un  signal  V  da  mlma  format  qua  la  signal  LOO  brut  Wmu 
qul  ramplaaa  aa  darnlar  an  dllminant  au  maximum  laa  brulta  at  dlatoralons  du  falaoaau  LOC.  II  ragolt  daa 
Informations  radio  at  daa  lnformatlona  da  vltassa  lsauaa  d'una  oantrala  k  lnartla  I 

-  yMts  signal  LOO  brut  lasu  du  rdoaptaur  ILS  an  mloro-ampkraa  ( pA) 

•  £>j|ida  signal  gilds  brut  (H3)  an  mloro-ampkraa 

-  tig*  altituda  laaua.du  radlo-altlmktxa 

•  VN.  ,  VE_  vltaasa  par  rapport  au  sol  projatda  salon  laa  axaa  Word  at  Eat,  lndiqude  par  la  osntra- 

1  ^  la  k  lnartia  du  typa  IMS  ou  ISS. 

La  fonotlonnamant  du  flltra  LISS  aat  ddorlt  rdfdranoe  (1). 

Rappalona  qu'll  aat  basd  aur  la  flltra  da  Kalman-Buoy  an  profltant  du  fait  qua  laa  daux  maauraa  affeotudas 
aont  antachdaa  d'arraura  da  natura  dlffdrsnta  (flgura  1)  « 

-  La  rdoaptaur  LOC  ddllvra  un  signal  proportiormal  k  I'do&rt  angulalra  antra  la  droita  avlon-dmattaur 
I.OC  at  l'axa  du  falaoaau.  On  obtlcnt  l'doart  mdtrlque  par  rapport  k  l'axa  falaoaau  gr&oe  k  la  oonnalsaanoa 
da  la  distance  avlon-dmattaur  D  at  da  la  aansibllitd  du  falaoaau  3)  t 

ymaa  7maa  jjf”  Tvral  +  ybruit  loo  (1) 

oti  y bruit  loo  00,,|Pr*ntJ  'les  brulta  radlo-dleotriquea  at  las  dlatoralona  du  falaoaau,  dont  la  moyanna  aat 
nulla, 

-  La  centrals  k  lnartia  nous  fournlt,  psr  projection  daa  vlteaaes  Word  at  Eat  aur  un  axa  parpandlou- 
lairs  k  l'axa  plate,  la  ddrlvde  da  l'daart  latdral,  c'aat-k-dira  la  vltaasa  latdrala  da  l'avlon  yf 

yI  "  yvral  +  ®VT  (?) 

oti  a^j,  sat  l'arraur  da  vltaasa  da  transversals  dQa  aux  arraura  oonjugudas  da  projection  at  da  la  oantrala 
k  lnartia, 

2.2  -  Variables  d'dtst  satlmdai 

,  II  a'aglt  dona  ds  former  un  flltra  du  typa  "flltra  oompldmtntaire"  antra  oaa  daux  lnformatlona  y 
at  y_  qul  dlabara  la  position  vrala  i)  l'avlon  par  rapport  k  l'axa  mojan  du  falaoaau  qul  dolt  ootnol-  "** 
dar  ^vaa  l'axa  plate,  catta  position  sstlmds  9  aat  ratranafonnda  an  doart  angulalra  y  avant  d'etre  di« 
rlgda  vara  la  pllota  automatique  k  la  piaoa  da  l' information  LOC  brute  o  .  L1 optimisation  du  flltra 
noua  a  conduit  k  un  filtrage  atatlstlqua  d'ordre  A,  o'aat-k-dlra  qui  '  dvalua  4  variable!  d'dtat  • 

I'doart  angulalra  flltrd  (an  mloi'o-awpkrea) 
l'arraur  conatanta  ds  vltaasa  latdrala  lnertielle 
la  ddriva  avao  la  tamps  ds  l'errsur  ds  vltasss  latdrala 

1' angle  d'arraur  da  projection  daa  vltesaas,  o'ost-k-dlr*  la  diffdrenoe  antre  la  rdfdranoa 
da  projection  at  l'axs  moyen  du  faiaoeau  1,00, 


Ota  variable*  ddaoulant  du  modkla  daa  arraura  da  vltaaaa  da  la  oantrala  It  lnartla  qul  aara  txplloltd 
plua  tard  (of  ohap.  6). 

2.3  -  Evaluation  da  la  dlatanoa 

H  faut  oonnaltra  par  alllaura  la  dlatanoa  antra  1' avion  at  l'dmattaur  LOC  pour  falra  la  tranaforme- 
tlon  antra  laa  doarta  anjulalrae  ^Mg  <6U  y  )  •t  <**■  doarta  mdtrlquaa  yM(  (ou  9). 

Pour  salt,  un  flltra  ooaipldmantalr*  untra  una  Information  da  "dlatanoa  radio"  at  la  vltaaaa  longitu- 
dlnala  da  1 'avion  domda  par  la  oantrala  k  lnartla  dlabara  una  dlatanoa  hybrid#  u  ,  La  "dlatanoa  radio" 
aat  oaloulda  k  partir  da  l'altltuda  maaurda  par  la  radlo-altlmktra,  du  algnal  fllda  at  daa  valaura  moyan- 
naa  da  la  aanaibllltd  gild*  3g,  da  la  panta  gllda  ^  g  at  da  la  dlatanoa  antra  l'dmattaur  LOO  at  l'dmattaur 
gllda  la  long  da  I'axa  pitta  aolt  dgl. 

La  formula  da  saloul  aat  la  aulvanta  i 

D  ■  - !lS£ -  +  d  ,  (3) 

»■  ft  +  S,.  ^iw* 

Oatta  dlatanoa  pourralt  ttra  dvantuallamant  ramplaoda  par  una  dlatanoa  provanant  d'una  autrt  aouroa, 
par  example  la  dlatanoa  donnda  par  un  DME  implantd*  k  l'dmattaur  LOO  ou  anoort  la  dlatanoa  oaloulda  par  un 
ayatkma  da  navigation  da  cont  lnolua  dana  un  ayatkma  da  gaatlon  da  vol  (PMC). 


-  L'lnltlaliiatlon  du  filtraga  da  la  dlatanoa  a  lltu  quand  l'avlon  aat  rantrd  dana  la  portion  d'aa- 
paoo  ok  la  algnal  gllda  aat  llndalra,  c'aat-k-dir*  au  pats*  an  mod*  "malntlan  da  gllda".  Quand  l'avlon  aat 
an  paliar  avant  la  oaptur#  du  falsoaau  gllda,  la  dlatanoa  aatlmda  aat  la  "dlatanoa  radio"  flltrda  a Imple¬ 
ment  par  un  paaae-baa. 

-  L'lnltiallaatlon  du  filtraga  da  1'doart  latdral  £  a  llau  quand  l'avlon  aat  atablllad  aur  I'axa 
LOC,  o'aat-k-dira  au  paaaagn  an  mod*  "malntlan  da  LOO",  ' 

•  Bn  oaa  da  pannt  momantanda  da  1'ILS  ou  da  la  radio-aonda,  la  paaaaga  au  guldaga  k  1'alda  daa  aau- 
laa  Information#  lnartlallaa  repaid**  daa  arrtura  ddjk  aatimdaa,  a  llau.  En  daaaoua  da  100  ft  at  an  oaa  da 
panna  3L3,  la  ayatkma  dolt  Itra  oapabla  d'aaaurar  la  guldaga  da  l'avlon  Juaqu'k  l'lmpaot  at,  al  poaalbla, 
au  dtlk, 

-  La  ayatkma  ddtaota  dgalamant  laa  anomallaa  LOO  d'amplitud*  algnlflaatlva,  En  oomparant  la  dlffdran> 
oa  du  algnal  LOO  brut  to  at  du  algnal  flltrd  w  k  un  aaull  aaaaa  Important  pour  qua  1'on  aolt  *Qr 
qua  la  algnal  LOO  aolt  arrBMd,  on  paaaa  dgalamant  au  guldaga  Inartial  an  attandant  qua  l'anomalla  dlapa- 
ralaaa,  31  l'anomalla  LOO  dura  trop  longtampi,  la  ayitkma  at  ddolara  lnoompdtant  at  la  algnal  LOO  aat 
tranamla  au  P.A.  La  da  aurvla  aat  d'alllaura  fonotlon  du  dagrd  da  reoalag*  daa  aatlmatlona,  o'aat- 
k-dlra  du  tampa  affaotlf  da  filtraga, 

-  En  oaa  da  panna  da  la  oantrala  k  lnartla,  ou  tnoora  an  oaa  da  panna  auto-ddtaotda  du  oaloulataur 
1.133,  la  ayatkma  davlant  "tranaparant" ,  o'aat-k-dlra  qu'll  tranamat  diraotamant  la  algnal  LOO  brut  k  l' 
antrda  du  pilote  automatlqua, 


Ca  ayatkma  a  dtd  mis  au  point  k  l'oida  d'una  simulation  numdrlqua  da  l'anaambla  da  la  bouala  (a'f  fi¬ 
gure  2)  oompoada  daa  dlfl'dranta  aous-anaamblas  i 

-  l'avlon  almuld  par  laa  dquatlona  llndafiadea  du  Mouvemant  latdral, 

-  la  pilot*  automatlqua.  dana  la  modu  attarriasaga,  o'aat-k-dlra  laa  phaata  malntlan  da  LOO,  pul  dd- 
orab#  k  partir  da  JO  ft  Juaqu'k  l'lmpaot  aur  la  plate, 

-  laa  dlffdranta  ddtaotaura  plaoda  k  bord  da  l'avlon  fmirnlssant  laa  donnda*  ndatatalrta  au  P.A., 
o'aat-k-dlra  la  rdaaptaur  rr.,3,  la  oantrala  k  lnartla  (parti*  oap  at  vartloala  at  partla  lnartialla)  at 
la  radlo-aonda. 

Daa  antrdae  axtdrlaurea  k  oatta  bouola  vlennant  parturbar  aon  fonotionnamant.  C#  aont  auooaaatvamant  i 

-  la  vant  latdral  at  laa  turbulanoas  atmoaphdriquaa, 

-  laa  brulta  rauuaUlla  aur  la  rdaaptaur  IT.s  (algnal  gllda  pour  la  oaloul  da  la  dlatanoa  at  aurtout 
algnal  LOC), 

-  1#  modkla  d'arraur  <1*  la  radlo-aonda  prlnolpalamant  dO  au  profll  du  tarraln  aurvold  par  l'avlon, 

-  la  mod k la  d'arraura  da  la  oantrala  k  lnartla,  an  partlouliar  laa  arraura  da  vltaaaa  horllontala 
par  I'intarmddialr*  da  aaa  daux  oompoiantaa  avion  laa  axaa  Word  at  Eat, 

-  laa  oaraotdrlatiquaa  gdomdtrlquta  da  la  ptata  at  daa  Implantation*  daa  dmattaura  XL3. 

Nous  all  on*  examiner  suoaeasivamant  dana  la*  ohapltraa  aulvanta  ohaouna  da  oa*  antrda*  an  ddtalllant 
la  mdthoda  utlllada  pour  la  moddllaar. 

La  simulation  numdrlqua  a  dtd  affaotude  k  1'alda  daa  moyena  lnformatlquaa  da  I'Adroapatlal*  k  Tou- 
louia,  k  aavolr  un  ordlnateur  CKBER  172  ooupld  k  un  ordlnataur  ODO  6600  (of  rdf  j). 


3  - 

3.1  -  hdndraUtda 


Ct  ahapltra  na  fait  paa  axplloltamant  rdfdrenoa  k  l'dtude  Loo-Inartlal  pulaqua,  du  fait  qua  nous 
nou*  tournee  lmpoada  da  ne  paa  modlflar  la  Pllota  Automatlqua,  la  oornportamant  da  la  bouola  da  guldaga  da 
l'avlon  vl#-k-vla  da*  parturbationa  atmoaphdriquaa  n'a  pas  dtd  ohangd,  Capandant,  pour  rdpondr*  k  un  mar- 
ohd  d'dturiaa  aooorcld  par  1#  Sarvloa  Technique  da  l'Adronautlqu*  franqaia  (of  rdfdrenoa  (2;),  una  dtuda  a 
dtd  affaotude  k  I'Adroapatlal#  pour  raohernhar  un  modkl#  das  perturbation*  atmoaphdriquaa  qul  aolt  a*s*s 
proohe  da  la  rdalltd. 


29-4 


3.2  -  Analyst  atatlstlau*  dta  vants  rancontria 

Una  analyse  statlatlque  da  152  approcbea  da  l1  avion  "CONCORDE"  it  Toulouse  at  k  Brdtlgny  (Franoa)  a 
it6  affeatuia,  A  parti r  dee  enreglatrements  an  vol  at  das  mesures  da  trajeotolra,  las  vents  auxquela  1' 
avion  a  ete  sounla  ant  M  raoonstltu da  at  analyses.  Ca  sent  esaentlellement  las  vents  vartloaux  Wz  at 
loniltudlnaux  Wx  . 

3.2.1  -  Vawt  vsriloal 

Pour  etudlar  la  vent  vartloal  W.  >  different*  calouls  sur  las  ichantillons  ratenus  ont  ete  falts  i 

-  soustraotlon  da  la  moysnna  non  representative  d'un  ph4nomkns  rial, 

-  oaloul  da  l'iaart-typ#  da  la  turbulanaa  vortloala, 

-  oaloul  da  la  fonotlon  d' auto- correlation,  puls  oomparalson  avae  la  fonotlon  d1  auto- correlation  d' 
un  bruit  blano  flltri  par  un  flltra  pasat-pai  du  lar  ordra,  En  affat,  11  est  apparu  qua  1 ' 4tude 

das  fonotlon#  d 1  auto-oar relation  das  iohantlllons  da  vents  manures  etait  plus  priolsa  qua  oallas  das 
spaotraa  t 

la  fait  qua  las  anraglstramsnts  solant  Unites  (da  JO  k  60  seoondes)  anlratna  das  arraurs  Iroportan- 
taa  dans  la  oaloul  du  spectre,  alors  qua  oas  arraurs  sont  plus  faiblaa  sur  la  fonotlon  d'auto-oov rela¬ 
tion, 

3.2.2  -  Ytnt  horlsontal 

L'itud*  das  vants  horlsontaux  a  fait  apparattra  un  problkma  partlouliar,  cslul  das  vanta  moyans  at 
das  gradients  da  vant,  La  figure  3a  donna  la  vsnt  Wx  oslould  au  oours  d'une  approoha. 

Nous  oonstatons  qu'll  exists  une  oomposante  moyenne  non  aonatanta.  Pour  comparer  laa  turbulsnosa 
rtiallas  avso  las  turbulsnoss  diorltas  dans  lto  divert  modklas  offloials,  11  oonvlant  done  d'laolsr  oatta 
oomposante  moyenns  pour  ne  garden  qua  laa  friquanoas  plua  important#!*,  Caul  noua  parmattra  da  plus,  da 
aomparar  laa  aomposantea  moysnnss  sux  (radiants  ds  vsnt  proposes  par  las  different*  modklas, 

Dans  o*  but,  11  a  fallu  trouvar  una  method#  qui  psrmatta  ds  n*  gardsr  qu*  Isa  hsutss  frequsnoss  das 
enrsglstrsmsnts,  sans  pour  autant  diphaaar  ou  affaibllr  laa  frequanoa*  volslnsa  da  la  frequanoa  da  aoupu- 
ro,  oar  alnon  Its  oalouls  sont  ftuaaifa, 

Four  oala,  plutbt  qua  d'utlliaar  un  flltraga  temporal  olasalqua,  un  flltrag*  par  la  method#  da  la 
tr ana forme#  da  Pourrier  a  ete  applique,  II  permet  da  falra  un  flltraga  Ideal  i  aaulaa  laa  frequanoaa  de*i- 
re«a  aont  oontarve**,  aana  auoun  affalbllsaemant,  La  figure  3b  presanta  laa  reaultata  du  flltraga  pour  la 
vant  trace  figur-i  3a  t  d'un  a8te  la  oomposante  moytnnt,  da  l'autra  la  turbulanaa  horlaontals. 

La  method*  d4jk  utilise*  pour  1*  vant  vartloal  paut  alora  Str*  applique*  k  la  turbulano*  horlsontal* 
oaloul  de  l'iosrt  typa,  da  la  fonotlon  d'auto-oorreistion  at  enfin  da  la  constant*  da  tamps  du  flltra  du 
bruit  oolore  qul  spprooha  la  mlaux  l'anraglstramant  etudie. 

3.3  -  “ 

Laa  resultats  da  1* analyst  ststlatlqu*  das  vants  ont  ete  compares  sux  modklas  propose*  par  las  ssr- 
vlosa  officials  amerloalna  (F.A.A.  j  olroulalra  AC-20-57  A)  *t  anglais  (c.A.A.  j  modkl*  da  la  norm* 

T.a.a.  1.2). 

La  flgura  4  donna  la  oorreiatlon  qul  axista  antra,  d'un*  part,  laa  ecarts  type  Uu  vant  vartloal  at 
da  la  turbulanaa  horlsontal#  at,  d'autre  part,  la  vant  moyan  k  una  hauteur  da  33  ft,  oomparea  k  oelle  das 
modklaa  offloials, 

Noua  sn  didulson*  its  points  sulvants  i 

-  Las  ecarto-typas  da*  turbulanoaa  vartloalas  at  horlsontal**  aont  pratlquanwnt  lnd<p*ndanta  du 
vant  moyan  lorsqu#  o#lui-ol  ast  inferiaur  k  15  kts,  Us  aont  anvlron  da  1,5  kts  pour  W  at  pour  VI 

II m  n'augmantent  qua  loraqua  la  vent  moyan  ddpaaaa  15  kt*.  Un*  combinalaon  das  modklas  FAA  at  CAA 
permat  d«  i-apriianter  is  phenomkn*. 

-  L'inergis  du  vant  vartloal  tat  oonoantre*  vora  las  bassss  frequsnoss,  1*  periods  do  ooupur*  ast 
d*  6,5  »«o  sn  moyann*. 

-  la  repartition  du  spaotr#  das  turbulsnoas  horlsontalsa  oorrsspond  k  osllas  dan  modklss  FAA  ou  CAA, 

-  La  oompoaante  moysnna  du  vant  horlsontal  qu'll  faut  ajoutar  aux  turbulanaas  horizontals*  present# 
un*  evolution  avso  l'altltuds,  mala  surtout  alls  pressnts  das  disoontinuite*  qul  na  peuvent  Str# 

gdnereas  qu*  par  un  proosasua  partloulisr,  C*  prootsaus,  du  typ*  ds  Poisson,  sst  oaraoterlsi  par  das 
sauts  k  das  instant*  aieatolra*  obeiasant  kuna  lol  da  Raylelght,  I'amplltud#  das  rafales  etant  aieataira, 
reparti*  aulvant  un*  lol  gauasianna, 

3.4  -  Modkl*  utilise  dans  las  simulations  Loo-Inartial 

Noua  avona  oonsidere  deux  oas  dlfferants  ds  vsnt  lateral  pour  las  simulation*  du  guldaga  hybrid*  ra- 
dlo-lnart.tel, 

-  Un  vent  moyan  dont  la  ssula  oompoaante  est  parpandioulalra  k  la  plst#  st  vaut  10  kts. 

-  Un  vent  fort,  dont  1*  module  vaut  25  kts,  dlrigi  da  telle  sort*  qu'll  s*  dioompoae  en  un  vant  da 
faoe  da  20  kts  at  un  vant  lateral  de  15  kts,  e'est  la  vent  maximum  oartifld  pour  affaotuer  un  at- 
terrlaBage  automatique, 

A  ohaaun  rl#  aas  vents  oonatanta,  nous  avona  aBaocii  lea  turbulanoaa  telles  qu'ellea  aont  diflnlea 
dars  la  olroulalra  FAA  AC-20-57  A,  Lsur  speotre  obeit  dono  k  la  lol  i 

(j)(co)  =  ~~  — ^ 

avao  O’  -  0,15  V  oh  V  aat  la  oompoaante  moysnno  du  vent  traversler,  at  T  »  Jj  oti  I,  -  600  ft  et  V 
V  y  Vo  0 

sst  la  vlttBse  airodynamlqua  da  l'avl.n. 


4.1  -  Modklaa  exlatanta 

L ' annexa  10  de  la  rdglementation  OACI  (Organisation  da  l'Aviation  Civile  International)  donna  las 
spdolfioatlona  das  installations  ILS.  Nous  sommes  surtout  eonoernda  par  la  module  du  faisceau  LOC  pour 
l'dtuda  du  guidage  hybrids  Loo-Inertial,  La  figura  5  presents  las  valaurs  1  na  pas  ddpasssr  avao  une  pro¬ 
bability  aupdrlsurs  k  5  %  an  oe  qul  oonoarna  las  ooudas  d'allgnanwnt  das  faisoaaux  LOC.  Toutafois,  la  do¬ 
cument  OACI  na  prdolsa  pas  la  spaotra  das  bruits.  Rappelona  qua  oa  qul  nous  increase  lol  sat  la  bruit 
global  oomprenant  las  dlstorslona  spatialas  ou  tanporallas  du  falsaaau,  male  ausai  las  bruits  radio  dlen- 
trlquas  raoualllis  par  1 'antenna  LOC  at  las  bruits  propres  du  rdoaptaur.  La  signal  k  analyser  eat  duno 
la  dlffdrenos  antra  la  sortie  du  rdoepteur  LOO  at  la  signal  oorrespondant  k  la  position  laterals  da  1* 
avion  par  rapport  k  l'axs  da  la  plate, 

4.3  -  Analyte  da  aualaues  faisoaaux  LOC 

Nous  prdssnton*  un  example  ds  bruit  Loo  reoonatitud  k  partlr  das  oalouls  de  trajeotolra  figure  6.  L* 
enraglstramant  s  dtd  so park  an  deux  dohantillona  afin  d'dtudisr  l'lnfluenot  da  la  dlstanoa  aur  las  oa- 
raotdrlatiquss  du  bruit  LOC.  Nous  donnons  ansuits  las  oalouls  da  moyenns  doart-type  at  fonotlon  d'auto- 
oorrdlation  (figura  6).  pour  sa  mime  falaoatu,  Du  fait  qu'll  axiats  una  trka  bass*  frequence  dans  la 
bruit  dtudid,  las  moysnnsi  dss  dsux  dohantlllona  sont  dlffdrantas. 

Nous  avons  snauits,  aomru  pour  la  modkls  da  vants  propose  au  ohap,  J,  ohsrohe  k  trouvsr  la  flltra 
passe  bsa  du  lar  ordre  qul.  syant  k  son  entree  un  bruit  blano,  posskda  una  aortia  dont  laa  camctdrieti- 
quaa  sont  aussl  proohes  qus  possible  dss  oaraoteristlquss  resiles.  Pour  oala,  11  faut  Identifier  la 
fonotlon  d'auto-oorreiatlon  avao  t 

Jtl 

B  (t)  .  (  tre+  m8)  .  (5) 

ob  r  ait  la  constants  du  tamp*  du  flltra  oharohe, 

4.3  -  Modkle  da  bruit*  dt.faisoa.au  .LOC 

L'etuds  d'un  total  dt  IS  faisoaaux  LOC  (deux  faisoaaux  frangsis  foumls  par  Is  Servlos  Technique  de 
la  Navigation  Adrienne  frangaia  (3TNA)  et  dix  faisoeaux  andrlcalne  lasus  du  rapport  rdf  (4)),  nous  a  con¬ 
duit  aux  oonolusiona  sulvantss  i 

-  Osa  faisoaaux,  d'una  gdndratlon  anoisnns,  ns  rdpondsnt  pas  aux  apdoifloatlona  des  oatdgorlss  II 
ou  III,  leur  doart  type  dtant  trop  Important  (6, 13  uA  au  lieu  ds  2,5  ufl),  Xls  dormant  aapendant 

una  bonne  ldda  da  la  abruatura  das  faisosaux  LOC.  '  ~ 

-  A  meaure  qua  l'on  s'dlolgn*  du  aauil  da  la  piste,  la  oonatante  da  tamps  du  flltra  paaaa-baa  tal 
qua  lea  fonotlons  d'auto-odrrdlation  solant  proohaa,  augments,  o'ast-k-dlre  qua  laa  hautes  frd- 

qusnaaa  du  bruit  sont  plus  lmportantes  k  dlstanoa  falbla  de  1'dmattaur  LOC  plutfit  qu'k  dlstanoa  dlavds. 

Du  fait  qus  las  doarta-type  das  bruits  sont  pratlqusment  equivalents  pour  d'una  part  laa  dohantlllona 
loin  da  la  plate  at  d'autre  part  laa  dohantlllona  prda  da  la  piata,  laa  valaurs  du  spaotra  du  bruit  LOO 
pour  las  basses  frdqusnoss  sont  plus  important!!  k  dlstanoa  dlavda. 

La  modkle  da  bruits  LOO  mis  au  point  (figura  ?)  tlant  oompte  da  oae  remarquea,  II  sera  gdndrd  par 
un  bruit  blano  paaaant  au  travers  d'un  flltra  paaaa-baa  dont  la  constants  de  temps  dlminue  quand  la  dis- 
tanaa  au  aauil  da  piste  dlmlnua,  pula  multiplld  par  un  gain  variable  avao  la  dlatanoe  at  flltrd  anfln 
par  un  paaaa-baa  ds  0,5  aso  da  oonatante  ds  tamps.  En  final,  la  niveau  du  bruit  blano  eat  rdgld  pour  qua 
l'doart  type  du  bruit  LOC  aoit  da  2,5  U A  au  aauil  da  piste,  da  tulle  sorts  qus  laa  valaurs  OACI  solant 
raapaotdaa.  < 

En  gdndrali  dans  las  simulations  d'attsrrissage  automatlque,  on  utilise  un  bruit  dont  Is  spaotra  eat 
donnd  par  l'dquatian  (4) 

avec  0"«2,5|jA  et  T  -  0,5  aao 

La  nouveau  modkle  ddflnlt  das  bruits  ob  las  hautes  frdqusnoss  ont  molns  d' importanos.  Ls  niveau  du 
apsotra  dans  la  bando  do  frdqusnae  do  la  rdsonnanoo  ds  la  bouole  ds  guldaga  da  l' avion  (pdrioden  aao 

ost  dono  ralovd. 

On  n'attalnt  ospendant  pas  Iss  valaurs  maximum  spdoifldss  par  l'oACI  pour  las  dlstanoes  dlavdaa, 

Nous  avons  malgrd  tout,  dans  1'dtuda  dss  rdponsee  du  flltra  Loo-Inartisl  tux  dlffdrsntsa  oourburss  dt 
faisoaaux,  utlllad  das  dlstorslona  k  la  limits  ds  la  courbe  OACI,  Mala  de  talles  oourburea  n'ont  paa  ser- 
vl  pour  las  oomparaisona  atatiatiqusa, 

4.4  -  Modkle  de  bruits  da  faisoaau  glide 

Nous  avons  utlllad  ls  signal  gilds  pour  reaonatltuer  la  dlstanoa  k  1'dmattaur  LOC  (equation  (3)).  de¬ 
pendant,  du  fait  qua  oa  signal  n'lntsrvlant  qua  comma  perturbation  da  oatta  bouole  da  dlstanoa,  la  moddll- 
satlon  du  signal  glide  n'a  paa  dtd  dtudide.  Nous  avons  utlllad  un  bruit  dont  la  spaotra  eat  donnd  par  l1 
equation  (4)  aveu  cr -  10  uA  at  T  ■  0,5  secondea,  valaurs  habituellemant  utilladee  pour  laa  simula¬ 
tions  d'atterrlaaago  automatlque. 


5  -  MODELS  PE3  BRUTT3  RECUE  gLIfl  PAR  LA  BADI0-3QH)E 

Nous  utillaons  loi  "bruits"  au  aens  large,  o'aat-k-dira  diffdranoa  antra  l'altituda  mesurde  par  la 
radlo-aonda  et  l'altitudo  gdomdtrlqua  rdalla  dans  dao  axes  lids  k  la  piste,  la  rdfdranoa  dtant  par  example 

l'altituda  du  aauil  da  la  plate.  Laa  "bruits"  inolusnt  done  ls  prof 11  du  terrain  survold,  las  perturba¬ 
tions  radio-dleotriques  de  propagation  da  l'onda  radio  at  las  bruits  propres  du  rdoepteur, 


v.  ■ 


:■  . 


C'aat  k  nouveau  k  partir  das  caloul*  da  raoonatltutlon  da  la  trajeotoira  qu'on  paut  oalouler  le 
bruit  raouallli  par  la  radio-sonda.  A  l'aida  das  maaurea  offaotudea  par  las  oinethdodolitea,  dventuel- 
lamant  oorrigde*  par  filtraga  avao  das  informations  d'aoatfltf ration  vartloale  issua  d'una  oontmil*  k  inar- 
tla,  on  rsoonstltua  I'altituda  da  I'avlon  par  rapport  au  saull  plats.  On  obtlant  alors  la  bruit  da  tar- 
raln  par  aoustraotlon  avao  l' Information  da  radio  altituda.  La  flgura  8  prdsanta  las  prof  11s  da  tarraln 
alnai  oaloulda  pour  S  plataa  k  Toulouos, 


La  bruit  da  tarraln  ant  almuld  par  la  sonna  da  daux  fonotlona  t 

•  Un  bruit  aldatolr#  ddorolssant  k  raasura  qua  I'avlon  s'approoh#  da  la  plats  pour  moddllaar  la  fait 
qua  la  tarraln  ant  an  gdndr*l  plat  aux  aborda  du  saull  da  plat#, 

«  Una  panta  moyanna  du  tarraln.  ffcua  raparlarona  da  oatta  pants  moyanna  dans  la  definition  das  oa- 
ractdrlstiqua*  gdorndtrlquas  das  installations  (chap,  7)  oar  alia  aara  combines  aux  autraa  arraura 
afln  qua  la  oaloul  da  la  distance  D  (equation  (j) )  solt  parturbe  au  maximum. 

La  apsotra  du  bruit  aieatolro  avant  multiplication  par  la  gain  deorolsaant  avao  la  dlatanoa  au  saull 
(of.  figure  9)  ait  oalul  donne  equation  (4)  avso 

CT»  JO  ft  T  ■  5  aao 


6.1  -  DaeorlPtlon  da  la  osntrals  Inartlslls  utll.ae* 

La  oantrala  lnartlalla  utilise*  ast  du  type  I  S  S  (ou  I  N  a).  AUI-IOTEF.  a  oholsi  la  oantrala  M  0  C 
JO  da  3AOEH  pour  equipar  saa  AIRBUS.  0*  ayatkm*  utillaa  un*  plate-form*  stabilise*  k  quatra  axes  da  oar- 
dan,  aasarvls  k  raster  horizontal*,  L'un*  das  oaraoterlatlqusa  da  oa  type  da  oantrala  ast  ds  prdasntsr, 
lnddpendasment  das  mouvamsnta  du  vehloula  qul  la  porta,  uns  tsndanoe  k  oaolllar  avso  la  periods  dlta  da 
"SoMllar"  ddflnls  par  i 

T  ■  2  ^  \j  |  (6) 

ofa  R  sat  la  dlatanoa  au  oantra  da  la  terra  at  g  I'aooeieratlon  da  la  pesanteur, 

A  la  surfaot  da  la  tarra,  on  trouva  7  «  84  minute*,  Da  o*  fait,  1 'evolution  das  arraura  hiirlsonta- 
las  da  vitaaa*  present*  un*  oscillation  k  oatta  period*. 


La  saul  fait  da  mattr*  1*  oantrala  sou*  'tension  alors  qua  I'avlon  raat*  limsobll*  au  sol  deoltnoht 
l'osolllatlon  da  SohUlar.  La  flgura  10  donna  Is*  evolutions  das  daux  oompoaanbaa  ds  la  vltasaa  indlqjda 
par  la  oantrala  MOO  JO  alors  qua  1*  vltasaa  reslls  du  vehloula  sit  nulla.  Nous  avona  dono  dlraotamsnt 
las  srraurs  ds  vltasaa  da  la  oantrala. 

Nous  oonatatona  qua  las  arraura  sur  ohaoun  das  2  axis  aont  indApandantsa  l'un*  d*  1' autre,  at  qua 
laura  amplitude*  aont  aieatolra*  mala  bomdao,  0*a  arraura  oorraipondant  tout  k  fait  aux  arraura  oalcu- 
ie*s  par  simulation  da  la  oantrala  an  lntrodulsant  laa  different!  types  d'arraure  das  gyromktras,  do* 
aooeieromktraa  at  die  arraura  da  oalaga  das  axis  ssnslblss  ds  oss  instrutnsnts  (of  rdferanos  8  ), 

Laa  ohiffras  fournia  par  SAtffiM  pour  la  MOC  JO  dont  la  osrol*  d'equl-probabllite  (CEP)  eat  da 

а,  5  M/h,  aont  las  suivanta  i 

-  erraur  ds  vltasaa  t  ±  14  kt 

-ddrlva  tsnporelle  ds  oatta  arreur  t  £  1  kt/mm  (valaura  k  95 

б. J  -  Hodkla  ratenu 

Laa  parformanoaa  du  flltr*  LISS  ddpenuunt  an  grand*  partlo  da  sa  oapaclte  k  rdaorbar  aas  arraura  da 
vltasaa,  11  a  aambld  lntdreasant  da  fair*  varlar  aldato) ramant  oaa  valaura  avso  un*  repartition  gaum 1 an¬ 
na  da  moyanna  nulla,  Laa  ioarta-typa  sent  las  aulvantw  t 

-  arraur  da  vltaas*  Word  au  Est  cr -  J,6  m/t 

-  ddrlva  tamporall*  das  vltsssee  Nord  ou  Est  O’  -  0,0O4j  ra/*2 
ohaouna  das  arraura  sur  Isa  axes  Nord  ou  Est  dtant  non  oorrdiess. 

Compta  tanu  du  fait  qua  la  durda  da  l'approoha  est  llmltd*  vis-k-vift  d*  la  pdrloda  da  SchUlsr  (un*  appro- 
ohe  dura  5  k  6  mlnutaa  au  mnxlmun,)  on  pourra  aonsiddret'  qua  laa  vltaaaaa  inartlellaa  indlqudas  pauvant  ■' 
darlr*  ■ 


l  la  .  ' 

VNI 

"VN  +AVN  + 

jj 

VEI 

-vE  +  AVj,  + 

(7) 

/  K  9i 

ati 

Avm  .AVe 

•  ft  •  Yi 

sent  des  aonstantas  au  aours  d'une  approoh*. 

Le  terrain  d'attarrlasaga  aat  diflnl  par  lea  different#  parawktrea  i 


*  •  \  •' 


-T  »* 
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TV 


■  ^  pente  moyenne  da  terrain  avant  la  aaull  da  Plata 

-  pants  du  falaoaau  gilds 

-  aonsibllltA  du  falaoaau  Loo  (an  yk/  rd) 


-  d 

i 

-  d 


Si 


•1 


dlatanoa  antra  Amatteur  loo  at  Amatteur  gilds  oomptAa  la  long  da  l'ax*  plats, 
dlatanoa  antra  Amattaur  glide  at  aaull  da  plats 


-  3^  aeualbllltd  au  point  ds  rapkr*  ILS  (aaull  da  plats)  an yk/m. 
Nous  avona  la  ralatlon  t 
3  -  3, 


dgl  +  dag 


(B) 


La  tarn*  Sy  sat  Impost  par  l'O  A  0  I  k  una  valeur  da  1,48  yk/a  avao  una  tolArano*  ds  ±  0,25  yk/m 
(valsur  k  95  $0.  La  aanalbllltd  du  falaoaau  Loo  varla  done  bsauooup  avao  (  d(1  +  djg)  o'aat-k-dlra 

avao  la  longuaur  da  la  platal  Trola  oaa  ont  dona  ltd  ohoisls,  l'un  reprAsantatif  d'una  plats  moysnns, 
laa  daux  autraa  Atant  das  oaa  axtrimaa.  Ha  aont  donnAa  figure  11,  Itou*  y  avona  aaaoolAa  daa  pantsa  mo- 
ysnnea  du  terrain  da  tails  aorta  qua  la  rapport  ^  u  transforation  daa  Aoart.  angulalraa 

(an yk)  an  Aoarts  mAtriquas,  aolt  oorraot  dans  un  caa,  maximum  dans  la  21kme  oaa,  minimum  dans  la  Jlkme. 

Pour  tanlr  oompts  ds  la  variation  tamporalla  da  la  isnalbllltd  du  falaoaau  Loo,  noua  avona  poaA  i 

sy  ‘  Sy  +  iSy  M 

oil  Sy  sat  la  rAaultat  d'un  tlraga  alAatoir*  da  moyanna  nulla  at  d'Aoart-typa  0"  ■  0,125^»A/m.  La  valsur 

i s  sat  oonatanta  au  ooura  da  l'approch*. 

y 


8  -  SIMULATION  PE  L'AVIQU.PU.PIL.OTE  MML’ 

8.1  -  siimaation  da  l1  avion 

Noua  oonaidArona  qua  laa  Aquations  latAralaa  da  1' avion  aont  pau  InfluanoAaa  par  son  mouvamsnt  lon¬ 
gitudinal.  La  aysttme  sat  done  dAorlt  par  3  Aquations  llnAarlsAea  autour  da  la  position  d'Aqulllbra,  1* 
Aquation  da  force  latArala,  las  Aquations  da  momant  ds  roulls  at  laoat  ;  on  obtlant  la  ayatkma  t 


h*  Vp^o  +  yH +  y+'b  -V  >i‘Sr 

l“»  a  L(1 .  pai,o  +  L|o  •  Pa  +  U  •  +  U|,  .  S|a  +  Lfcr  • 

ir4  a  Nip.  Pairs  t  4  Ngp -S|o  +  N5r.Sr 

Laa  angles  d'Euler  aont  anaulta  obtenus  par  IntAgratlon  t 

^  =  h  +  ¥o.n 
^  "  ssW 


(10) 


(u) 


oti  pj.  at  ^  aont  laa  vitansan  da  roulla  et  laoat  dans  leu  axes  avion  aiora  quo  pg  at  rs  aont  laa  mArnaa 

vlteasaa  dana  lea  axes  da  stability  dAoalas  de  l'lnotdance  o<  par  rapport  aux  amt  avion. 

Noua  avona  nuirl  : 


P 


aAro 


ool 


(12) 


oil  vv  eat  la  vent  lateral  et  la  turbulence  MBOoiee. 

La  vitaane  laterals  du  centra  da  gravltA  eat  oalnulAe  ains!  i 

5ca  *V«C0*?»  ^  (13) 

d ' oti  l'on  dAduit  Lea  ooordonnAas  dec  differanta  points  de  1 'avion. 

8.2  -  aimulatlon  daa  oraanea  de  oommanda  automations  du  voL 

La  but  du  ayetAme  da  commands  automntique  du  vol  eat  d'Alaborer  laa  dlf'fArenta  orrirea  A  appllquer 
aux  oarvo-moteuro  et  aux  nervo-oommandas  las  gouvarnaa  de  l'avion.  Saul  la  pilot*  automatiquo  latAral  du 
oonotruoteur  3FKNA  a  AW  eimulA, 

II  a  AtA  dAeompoaA  an  Aquations  tol  quo  leo  dir  Wren  ten  variables  d'etat  Internee  appaiaiasant,  Deux 
modes  nous  IntAraaaent  parti ouL lArement  i 


-  la  mod*  malntlen  I.oo,  sctlf  dts  qua  I'Auart  Loo  itriu  du  reoepteur  T,nc  reate  infArlour  k  15  U, 
pendant  10  seoondea,  A  partir  de  700  ft,  leo  gains  ile  la  bouole  de  baBe  Avoluent  Juaqu'aux'v. 
du  mod*  "LAND  Trank". 


valours 


-  lo  mode  de  dAorabe  qul  permet  d'annuler  A  partir  tie  >0  ft,  l'Aoart  de  rap  dO  h  un  vent  de  travel's 
non  nul. 

Du  fait  quo  1 '  InWgrat  I  on  don  Aquations  illfferenttelles  ainai  obtenues  se  fait  aveo  un  pas  de  20  mil- 
lioeaondea,  touten  len  ronntanten  do  temps  inf'drleuren  A  0,1  ceo  ont  AtA  supprimAen  ou  regroupAes  entre 
elleo  afln  qu'll  y  alt  au  molns  un  rapport  dr  5  entre  la  plus  petite  eonatante  de  temps  flimulAe  et  le  pan 


■T. 

t  i,i 
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da  oaloul, 

\ 

8.?  -  Simulation  dea  ddteoteura 

Pour  oompl<t«r  la  bouele  da  guldage  de  1 'avion,  11  na  nous  raste  plus  qu' Ssmodeiiaer  lea  diff<rents 
d4teot«ur»  qul  envoi  ant  laura  aigneux  au  pllota  automatique,  Saula  ceux  dont  la  lonotlon  da  tranal’ert. 
fait  apparaltra  una  eonatanta  da  tampa  aupirlaure  k  0,1  aao  ont  iti  almulia  par  un  almple  f litre  paaaa- 
baa,  Lea  dlffirantaa  oonatantaa  de  tampa  aont  t 

-  0,1  aao  pour  lea  rdcepteura  Loo,  glide  at  radio  aonde  at  pour  le  gyromktre  de  laoet,  — , 

-  0,lg  a*o  pour  1  'aoo^Kromktre  lateral, 

8,4  -  Initialisation  dea  varlablea  d'etat  de  l1 avion  at  du  P.A 

-  tea  dlfferantaa  variables  d'etat  du  pllota  automatlqua  aont  lnltlallaeea  da  tail#  torte  qua  la 
ayatkma  aolt  an  equlllbre  k  l'lnatant  oil  la  snloul  eat  lnltlallae. 

•  Laa  varlabiaa  d'etat  da  l'avlon  aont  auaal  oalouieea  da  talla  aorta  qua  l'equlllbra  aolt  reallae 
lnltlalement.  Alnal  t 

•  Ps„l  =  ^  »  T? 

•  q?i  -  p 

oil  vvQ  eat  la  vent,  may*  n  t  la  derapage  aerodynamlqua  eat  done  nul.  11  raata  deux  varlabiaa  k  lnltla> 
llaer  i 

'  U  i  position  laterala  Initial#  da  l'avlon  par  rapport  k  I'axa  plate, 

,  H  i  doart  da  route  Initial#  par  rapport  au  oap  geographlque  ^  f 

Cos  valeurs  dependant  da  la  quallte  du  guldage  da  l'avlon  avant  qua  na  oommenoant  laa  oaloula,  o'eat- 
h«dire  pendant  la  phaBt  da  oaptura  du  faianaau  Loo, 

Nous  avons  ahoini  une  initialisation  par  tlraga  slAatolra  aveo  una  repartition  gauaslennn  da  moyan- 
no  nulla  et  dUoart-type 


To.  . 


Tous  leu  nnlouln  de  nlmulatlon  (Marita  Jusqu'K  maintenant  (avion,  pllota  automatlqua,  periphurlquea 
flu  P.A.)  mint  den  iinlouln  ri ' Integration  (liquations  dlfferantlallas  du  premier  ordre.  lie  dolvent  dona 
se  falre  nveo  un  pan  de  onloul  asses  falhla  pour  que  la  precialon  solt  eufl'laante.  Nous  avons  ohoial  un 
pas  de  SO  mn, 

Pour  si muler  un  oaloulatsur  numerlqua  avea  un  autre  caloulateur  numerlqua,  11  aufflt  de  oholalr  le 
pas  de  aaloul  de  la  simulation  dgal  au  pas  de  cal nul  reel, 

En  effet,  dane  ae  oss,  lee  equations  programmeas  dans  le  oalaulataur  real  sont  k  reprendre  aans  rlan 
nhanger,  alors  qu'une  adaptation  eat  ndoaSHalre  dane  la  oas  oontralra, 

Du  fait  qua  lea  entries  do  vltosne  lnertlelle  aont  rafraiohlee  par  la  oentrale  k  Inertia  toutes  lea 
0,2  sea,  11  etalt  loglque  de  ahclslr  ae  pas  pour  le  oalaulataur  LTSS.  II  faudra  done  effeotuer  las  oaloula 
de  l'avlon  et  du  pllota  automatlque  lo  fola  avant  de  oalouler  k  nouveau  le  filtre  LISS.  Pendant  oe  temps, 

1 'entree  y  du  p.A.  aera  oonstante  (simulation  d'un  bloqueur  d'ordre  tiro), 

Rappelona  rapldement  lea  equations  du  filtre  de  Kalman  k  observations  disorktes  i 
.  Integration  do  l'equatlon  d'etat  entre  deux  observations 

„  W  r’.uM  us) 

ou  0  eat  la  matlkre  de  transition  du  syatkme  et  1^  la  matrloe  d  entree, 

.  Integration  de  la  mettle*  de  covariance  oorrespondsnto 

ZIn/n  , 

ok  Qh  eat  la  covariance  du  bruit  aur  l'etat, 

,  Calcul  du  gain  du  i'lltre  de  Kalman 

•  H  .  (  H,£mVfVHr+ 

oil  R^sst  la  aovariance  du  bruit  sur  l' observation  ynf^ 

.  Rooslaga  des  eatbjmtlana  k  l' Instant  n  +  1  ^ 

X  VH|/m)  =  Xnn/M  +  (yM44-  (10) 

.  Recalage  de  la  matrloa  da  covariance  h  1' mutant  n  f  1 

=  (l  “  Hi.  ^ I- Kmi*Hj  +  Kui •  ^ 

Ce  sont  oes  equations  (15)  k  U9),  tradultes  en  fonntlon  du  oas  partloulier  k  4  varlabiaa  d'etat 
(cf  chap,  ?!  qul  ont  ote  programmess  en  simulation,  Dana  le  can  oil  les  observations  V  (signal  LOC)  ne 
aont  plus  dlnponlbles,  aeulos  las  deux  equations  (15)  et  (16)  sont  oalouiees. 
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10  •  APPLICATION  m  U.  SIMULATION  A  LA  DKH0KSTHATI0N_D£3_PERggRMAfCES 
10.1  -  Facllltd*  off  rtf  par  It  simulation 

ATln  d«  faollltar  lk  ddoonstratlo,!  da  la  validity  die  la  simulation,  plueleurs  poesibilltds  sont 
offartaa  par  lea  programme  de  simulation.  Ce  sont  i 

-  la  traod  sur  papier  BENSON  da  toutae  laa  variable*  intarmdclialrsa  ndoaesafres  A  da*  vdrtfl- 

oatlons. 

-  la  possibility  d'utillsar  das  snraglBtraimnts  da  vol  oomns  entries  da  la  alSMlatlon  t  par 
axsmpla,  on  peut  aprka  oaloul  do  la  irajaetairs  da  1' avion  au  ooura  d'une  approoha,  pula  da*  bruit*  LOC  at 
das  vants,  rdintroduir*  oas  darnlars  dans  la  simulation  at  oomparer  avao  las  rdaultats  da  vol. 

-  la  oalaul  au  oours  da  l'approoha  d'une  variable  d'dtat  da  l'avlon  raprdaantant  sa  trajeotol- 
re  potantlallo  t 

^ Avion  =  +  f  ^*$1  (20) 

-  la  possibility  d'snehalnsr  pluslaurs  approctha*  l'una  k  la  suit*  da  l'autr*  avao  das  pertur¬ 
bations  rypytitlva*  qul  n*  ddpsndant  qua  d'un*  suit*  da  10  nombras  aiyatolras  pour  l1 Initialisation  du 
prooasuus.  On  paut  done  oomparer  1*  oomportamant  d«  la  bouola  da  guldag*  pour  da*  paramktras  da  ryglage 
dlffdrents,  mals  vis  k  vis  da  perturbations  idsntiquas, 

-  la  oaloul  da  variables  atatletiqusa  sur  un  certain  nontbrs  da  slriwlation*  d'approohea  euoae- 
slvan,  II  sat  possible  de  oaloulsr,  par  example,  moysnns  «t  dcart-typ*  de  t 

.  l'doart  latdral  4  100  ft,  k  15  ft  at  k  l' Impact, 

.  l'aaslette  latdrale  k  1' impact, 

.  la  vltasse  transversal*  du  train  k  l' impact. 


Par  allleurs,  on  oaloula  dgalement  un  paramfctre  rtdnommd  faotaur  A  pul  caraotyrlae  1 'aptitude 
da  l'avlon  at  du  P.A.  k  suiure  un  signal.  Sa  va.l*ur  ast  i 

oti  x  eat  la  variable  k  dtudier,  par  example 
at  n  eat  Is  nombr*  d'approohss  almuiyss, 

-  la  oooptablllaatlcn  das  approohss  ayant  entrafnd  so it  l'allumag*  dos  doarta  sxooaslfs 
LOC  (  20  pendant  plus  de  0,5  seoondea)  aoit  l'allumage  'u  voyant,  AUTOLAND  demandant  1'intar- 

ruptlon  de  1'atterrlsaag#  automatiqus  (doarta  exoeesifs  et  h  ^  200  ft). 

10. S  -  Slmulatlono  realladsa  pour  ler  ddmontitrationa  atatlatlauee 

A  ahaoune  das  daux  posslbllltda  de  vent  (vent  moyen  et  vent  fort),  noue  avons  ausooid  laa 
troio  eas  de  longuour  de  piste,  nolt  done  six  oas  dlffdrents.  Chaoun  de  osa  6  uas  a  rait  l'objat  de  100  si¬ 
mulations  d'attsrrinange,  ohaqua  epproohe  dtant  oaraotdrlsde  par  dee  turbulenoes  atmosphdrlquss,  dee 
bruits  LOC,  das  arraurs  de  central*,  une  eenslbllitd  LOC  et.  dee  valaurs  d' Initialisation  rile  la  position 
avion  toutes  dlffdrantes  lee  unes  deo  autree  at  obdlesant  aux  lols  ddfinieo  plus  haut,  Au  total  600  appro¬ 
ves  out  dtd  simuldes  pour  ddmontrer  Its  psrformanoos  du  guldage  hybrlde  LIS3  par  rapport  k  600  approohss 
effectudas  dans  laa  m8mao  conditions  at  aveo  les  mflmss  perturbations  an  guldag*  k  l'ald*  du  signal  LOO 
brut  (guldag*  LOC). 

La  rdfdrenoe  (l)  dorme  les  performances  oompardee  dea  daux  mrd*a  de  guldage  aveo  un  flltrugs 
Lon-Insrtlal  oorrespondant  aux  deux  objeotlfe  in,tialement  fixds,  k  savoir  i'lltrsge  dee  distortion*  du 
falaceau  LOC  et  oarvle  h  une  panne  LOC.  Noub  allops  maintanant,  examiner  lee  nouvellee  possibility*  du  ftl- 
trag*  Loo-Inertlel  an  ce  qul  conosrne  la  ddteotion  des  ddoalages  de  l'axe  moyen  du  falacenu  LOC, 


11  -  DETECTION  D'UN  FAI3CEAU  I, PC  DECALE  DE  L'AXE  PIUTE 
11,1  -  Ob.laotlf  da  la  ddteotlon  d'un  ddoalaxo  de  falaceau 

II  s'agit  de  parmsttre  k  l'avlon  d'atterrlr  sur  une  piste  dqulpde  an  catdgori*  II  avac  dea 
minima  da  vlaibilltd  de  catdgori*  III.  L’Airbue  eat  oortll’id  aveo  une  hauteur  de  ddnlsion  d*  15  l't  #t  une 
portde  vlsualle  1*  plats  d#  100  m  avco  las  dquipements  ndoessalres  k  un  attsrrlssage  de  oatdgorle  III, 

La  but  eat  done  d*  pouvolr  atterrlr  aveo  oatte  hauteur  de  ddoiaion  que  la  piste  eolt  agrdd# 
de  oatdgorle  II  ou  da  aatdgorl*  III, 

Un  US  de  oatdgorls  II  eat  dqulpd  d'un  etui  dmsttsur  LOC  et  d'una  survalllanoe  de  l'dmlsslon 
dont  le  oapteur  eet  plaod  k  quelques  centlmktres  das  adrlans  d'dmiselons,  alors  qu'un  IL3  de  oatdgorle  III 
frangals  a  un  dmettaur  normal,  un  dmntteur  de  secours  aveo  une  surveillanoe  interne,  unt  surveillance  de 
l'dmiasion  trlplde  aveo  vote  permsttant  d*  ohangar  d'dmstteur,  un  test  opdrationnal  'las  monitaurs  de 
surveillance  afin  d#  ddteoter  las  pannes  cachdoii  «t  *n?  in  urie  autr#  survalllanoe  "lointaine11  de  I'dmloalon 
plaode  de  l'autre  c8td  de  la  piste  at  qul  suivelll*  la  propagation  sur  la  plate, 

Le  but  de  la  detection  d'uri  axe  LOC  ddoald  k  l'atde  du  syetkme  LIS3  eEt  done  de  r^tabl.lr  par 
une  surveillanoa  externe,  lo  nlvstu  d'integrltd  du  signal  LOC  dmiu  par  un  ILS  de  oatdgorle  II,  de  telle 
serte  que  lee  probability*  de  pannes  oaahdes  oolent  identiques.  Par  allleurs,  le  eystkme  hybrids  radlo- 
inertle  permet,  grkoa  k  sa  function  eurvie,  do  rdtabllr  la  oontinultd  du  asrvloe  en  oas  de  pann*  de  l' 
dmetteur  LOC  qul  n'eet  pas  doubld  en  catdgorle  II, 

Du  fait  qu«>  aver  un  fulsoeau  de  oatdgorle  II,  la  hauteur  de  ddoiaion  deman  de  est  supdrJeure 
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4  1*  hauteur  minimale  d' Interruption  d'approohe  (HMIA  -  15  ft),  11  faut  dono  detecter  4  coup  sGr  un  d<5- 
oalage  du  fslsoeau  qul  amfcnarait  l'avlon  4  rencontror  un  obstacle  au  ooura  da  la  remise  da  gaz  pulaqu'on 
eat  sGr  qu'll  ne  touohara  pas  la  sol,  plat  aux  abords  limrfdlats  da  la  plsta.  La  premier  obstacle  exis- 
tant  set  l'antenna  d'dmlssion  du  signal  glide.  Cette  antenna  eat  vue  depula  l'antenne  LOC  sous  un  angle 
d'environ  deux  degree  par  rapport  4  l'axe  median  da  la  plate. 

11.2  -  Conditions  n<oa»salres  d'un*  bonne  il<tactlon  d'un  falsoeau  dfnalfl 
11.2.1  *  Expreaalon  da  l'erreur  de  vltessa  transversal* 


La  vltasse  laterals  resile  de  l'avlon  est  donn^e  par  la  relation  1 

Vve  00*  -VBln4\.t 

alors  qua  oella  oaloulke  dans  la  ftltre  LI3S  est  la  sulvante  1 
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Las  erraurs  das  vltesaes  Nord  at  Eat  de  la  oantrale  s'exprlment  par  alllaure  t 
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-  L'erreur  de  Vitesse  transversals  ast  dono,  oompts  tanu  du  fait 

*1U  -  ev„.amf^  f  S Re^-Vt)  +  SK0.(-cv*,imliiev-e/n,cos 


oG  est  la  vltesoe  longitudinals  de  l'avlon  Vj^  4  l'instant  d' initialisation  dea  oaloula. 

En  approonant  ohaaune  des  erreurs  de  vltesoe  Word  ou  Est  par  un  terms  constant  at  une  derive 
en  fonatlon  du  temps  (expression  (7)),  on  t.rouve  1 

eVT  «  A\4  +  Sfi..(Vu-V0  (S5) 

oG  AVr  1  )  SRo  so-it  des  oonstantes  at  (V^  -  )  est  l'ioart  de  Vitesse  par  rapport  4  la 

vltessa  de  l'avlon  k  t  •  0 

Cette  decomposition  expllque  lea  dtffrfrentea  variables  d'4tat  astim^ss  par  Is  f  litre  LISB 

(of  $  2.2). 

Dans  Is  oae  oil  le  falaosau  LOC  est  drfoaU  d'un  sngl#  A^7  ds  l'axs  ds  la  piste,  on  iKmont.re 
I'aoilsinant  qua  la  eauie  1'aqon  pour  lsnlar  aa  dlcalage  tat  que  la  rdf<ranoa  da  projection  dsa  vlteaneu 
R,  ootnolda  exaotement  aver,  le  cap  gdographlqu*  da  la  piste  U)  .  ,  On  a  alors  1 

®T  -  vl0 .  is,  .  AVt.  T  M> 

SR»  ■*  -  Ay 

L'expraanlon  (25)  montre  ygalement  qu'or,  ne  pourra  lsoler  l'erreur  Sro  du  terms  constant  AV,„ 
qua  al  l'<eart  de  vltessa  V,  -  V,  est  assaz  Important  pour  qua  les  estimations  du  f litre  alent  suf-  1 
flsamment  oonvergy,  1  i 


11.2.2  -  Influanoa  du  niveau  des  bruits  LOC 

L'  Evaluation  du  ddcalags  du  falsoeau  LOC  dolt  Stre  1'alts  aveo  un«  pr4nlalon  assaz  grande  al'ln 
que  le  teat  alt  un  sens.  Comme  on  dolt  avoir  une  probability  triis  falble  de  ddteoter  un  ddoalage  de 
falsoeau  alors  qua  oe  ddoalage  n’axlste  pas,  mala  auasl  du  fait  qu'll  faut  dlteoter  un  ddoilage  da  2* 
aveo  une  probability  volslne  de  1,  nous  avona  oholsl  la  uull  4  partir  duqusl  le  falsoeau  sera  Jug4  ddoa- 
iy  4  1*  .  En  arrlvant  4  une  pryolslon  de  1 'estimation  Ay  tel  qua  son  yoart  type  aolt  de  0,21  ,  noua 

sommes  sQrs  que  lea  probabllltye  asront  oorreotes, 

Le  ryglaue  du  f litre  basy  sur  las  objeotlfa  de  flltrage  et  de  aurvls,  dynommy  r4glaga  1 
(rdf,  (1))  eat  basy  sur  uns  yvolution  de  la  oovarlanoe  du  bruit  LOC  donn4e  figure  12.  Las  yoarts  types 
da  I'estlmation  du  dyoalaga  da  falsoeau  sont  porty*  figure  13  dans  pluslaurs  oas  devolution  de  vltea- 
ue,  o'ast-4-dlre  pluslaurs  eas  da  praoydure  d'approobe.  On  volt  ygalemsnt  l'influenoe  du  niveau  das  ^ 
bruits  LOC  affsotlvemant  ranoontrys.  Nous  oonstatona  qua  oa  ryglage  na  permit  pas  une  pryolslon  sur  Ay 
sufflsanta,  ' 

Un  deuxlkme  rdglage  du  flltra  LI33  oG  la  programmation  du  bruit  LOC  sst  doruMl#  figure  12  a 
dono  yty  ytudiy  pour  arrlvar  4  une  pryolalon  aufflsanta.  On  s'apergoit  sur  la  1'lgura  13  que  oe  ryglage 
na  donnt  satisfaction  qua  dana  la  oas  oil  la  bruit  LOC  affsotivement  ranoontr4  oorraspond  4  la  program- 
metlon  du  flltra,  II  eat  dono  nyosssalra  d'lmplantar,  dana  la  oalculateur  Lias,  un  circuit  dt  mesure  da 
bruit  LOC  effeotlvsmsnt  renoontry,  afin  da  aavoir  quail*  oonflanoe  aooorclar  au  dyoalaga  du  falaoaau  qua 
la  flltra  yvalue,  Co  olrouit  oaloule  l'ycart-typ*  du  signal  (  V)  -"n  )  qui  sst  uns  bonne  approxima¬ 
tion  du  bruit  LOC,  La  figure  14  donno  lc  pyaultat  de  0*  oalou/dans  1*  oaa  des  deux  bruit*  LOC  ytudiye 
pi'yoydawrant,  La  aeull  oholsl  pour  1#  niveau  du  bruit  LOC  aat  da  3  UA,  Au  d*14,  on  coneidfcrara  qua  le 
falaosau  LOC  aat  trop  bruity  pour  que  i'estlmation  dr  dyoalaga  de  l'axs  aolt  assaz  pinole*. 
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12.1  -  Aatlona  dt  lUaulpaxt  avant  It  d4but  dt  l'approoha 

L'equlpsgs  aura  A  at  disposition,  aur  un  boltlsr  sp^olsl  t 

-  un  eontaotaur  A  3  positions,  A  savolr  i 

.  LISS  "OFF"  ou  guldagt  LOC  l  position  1 

.  LISS  Rkglaga  1  "0«P  t  position  2 

.  LISS  M«1«(S  2  "ON"  t  position  3 

-  uns  molstte  k  4  digits  pour  avoir  una  precision  da  0,1*  psrmttant  d'afflonar  It  oap  gdographl- 

qut  dt  la  plats. 

Avant  la  oaptura  LOC,  11  faudra  dono  oholslr  la  position  du  oortaottur,  Dans  Its  2  prtnlkrta  po¬ 
sitions,  la  hauttur  dt  decision  atra  la  hauttur  dt  ddotslon  aotutllt,  Dans  la  troiaikma  position,  la 
hauttur  dt  ddoialon  aur  un  ILS  da  oategorla  II  tat  dlalnudt. 

18.2  -  saantta&sa 

Ct  ttat  tat  prdstr.td  figura  15.  Dana  It  oaa  ou  on  ddalrt  unt  hauttur  dt  dkoialon  dlmlnudt,  plu- 
slaurs  sot Ions  s'tnohalnuront  i 

-  verification  qua  It  o.ip  gdographlqut  dt  la  plsta  a  bltn  dtd  afflohd  avant  la  debut  dts  oaloula. 

-  k  200  ft,  un  tast  aur  la  prookdurt  auivlt  parmst  dt  tavolr  si  la  ddadldratlon  a  dtd  sufflsantt 
(Vlu  -  V,  ^  50  kts)  at  al  It  tamps  da  flltraga  a  dtd  aaati  grand  pour  qua  Its  animations  tolant  oorraotaa. 

Un  autra  tast  aur  It  bruit  LOC  dvalurf  au  oours  dt  l'approoha  parmst  dt  savolr  al  on  paut  fairs 
oonflanot  au  ddoalagt  dt  falsotau  Ivalut.  Si  un  dt  sts  taats  n'ast  paa  oorraot,  unt  slants  privltnd-m  l1 
dqulpagt  pour  qua  la  hauttur  dt  decision  solt  rtmonUt  k  aa  valtur  nominal*. 

-  k  100  ft,  taut  aur  dkcalag*  d»  falaotau  at  allumaga  dt  I'alamt  "AUTQLAH)"  al.  la  dkaalaga 
astlmd  aat  supdrltur  k  l*.  Dana  la  oaa  oontralrt,  l'approoha  rat  poursulvlt  Juaqu'k  la  hauttur  da  deci¬ 
sion,  altltuda  k  laqualle  la  pilots  fait  It  aholx  antra  toit  ranattra  1st  gaa,  uolt  oontlnutr  l'approoha 
si  la  vlalbllltd  it  paraat, 


13  -  mmm 

La  simulation  prtnd  da  plus  an  plus  dt  plaoa  dans  la  demonstration  dts  ptrformanots  d'un  ayatk- 
mt  srabarque.  Cat  a van tags a  ns  sont  pas  negligaablta  tant  pour  la  faolllte  dt  modification,  la  poaaiblli- 
te  dt  fairs  daa  etudaa  oomparatlvaa,  la  poaalblllte  d'etudlar  daa  oas  llaltas  qu'll  strait  dlfflolla  da 
ranoontrar  an  vol..  qua  pour  la  aoflt  plua  falbla  k  lWpoqut  oti  laa  easals  an  vol  davlannant  trka  oofltaux. 

La  but  da  oat  axpoie  etalt  da  demontrar  qua  l'etuda  d'un  spstkma  nouvasu  pouvalt  sa  fairs  k  l' 
•Ida  da  oat  outll  pourvu  qua  la  almulatlon  aoit  rapreaantatlva  das  phenomknao  Halt,  an  partloullar  an 
oa  qul  oonoama  laa  perturbations  dt  la  bouola  d'aaaarvlaaaiaant  oonoarnea. 

La  aystkma  hybrids  Loo- Inartlal  da  guldagt  lateral  d'un  avion  qul  voua  a  ete  preaante  repond  aux 
trait  objaatlfs  fixes,  o'sst-k-dlrs  Is  flltragt  dts  distortions  du  falsossu  LOC,  la  survls  k  uns  panns  da 
l'eamttaur  LOC  at  anfln  la  detaotion  d'un  falaotau  LOC  devie.  Pour  parmattra  la  realisation  du  3*  objao- 
tlf,  11  a  ete  neoassalra  d'evaluar  an  tampa  real  la  nivaau  das  bruits  LOO  qua  1 'avion  ranoontra.  La  ra»- 
paot  d'una  prooedura  d'approoh*  an  oa  qul  oonoama  l'evolutlnn  da  la  vltasaa  at  la  diatano*  da  la  oaptura 
LOC,  parmst  d'evaluar  la  decalagt  du  falaotau  LOC  avao  una  preolalon  sufflsantt  at  d'an  avartlr  1 'equips- 
ga.  Unt  aurvalllanoa  axtam*,  totalamant  indepandanta  da  oalle  qul  axlata  dans  l'lLS,  paut  dono  lira  as¬ 
sures  par  la  aystkma,  qul  pourrait  alnal  parmattre  daa  operations  da  oategorla  III  sur  daa  ILS  da  oatk- 
gorla  II. 

Ulterlauraawnt,  la  ayatkma  pourrait  egslamant  parmattra  d'obtanlr  una  hautaur  ft  deoioinlon 
nulla  sur  das  ILS  da  oategorla  III  pourvu  qu'll  aolt  asaooie  k  un  ayatkma  da  confirmation  da  la  position 
da  1'avlon  pour  s'tnaurtr  qua  la  guldagt  ILS  a  a monk  1' avion  au-dassus  da  la  plats, 

REFERENCES  i 

1  -  J.IHVQAS,  D.BUISSON,  F.LLORET,  X.LAQARDE,  Mai  1977  "LISSAOB  ET  EXTRAPOLATION  IWRHHLS  BE  FAISCKAUX 

ILS,  APPLICATION  A  L'AIRPUS  A. 300  B",  AOARD  CP  220,  paplar  3. 

2  -  J.XRVOAS,  D.BUISSON,  Mai  77  "ETUDE  DES  DONJEES  ATM03PHERIQUE3" ,  ohapitra  5.1  du  marohe  OTAk  n* 

76.95.217.00  sur  1 'optimisation  P.A  -  Visualisation, 

3  -  R. DEQUE,  J.L,B0»KE,  Ootobra  75  "MOVENS  E7  METOODES  DE  SIMULATION  WILISES  POUR  L'ETtDE  ET  LA  MISE  AU 

POINT  DE  L'ATIERniSSAQE  AWOMATIQUE  DE  COfCORDE"  -  AOARD  CP  I98. 

4  -  AUOUST  62,  "ANALYTICAL  STUDY  OK  ILS  BEAM  CHARACTERISTICS",  PAA  Contraot  n*  ARDS  -  451  -  from  XNDIX 

Corporation,  Eollpaa  Pionatr  Division 

5  -  P.PAURRE,  1971,  "NAVIGATION  INERT IELLE  OFTIMALE  ET  KILTRAOE  3TATIOTIQUE"  -  Collaotlon  "Methodaa  ma- 

thematlquaa  da  l'lnformatique,  Ed.  Dunod  -  PARIS, 


Integration  du 


Ibrkultwct  Wx 


BRUITS  DE  FAISCEAUX  CAT  II  ET  III 
.  (COUDES  D'ALIQNEMENT) 

/4  A 

(VALEURS  A  95  %)  - 

Cut'll  tmJ  m  loe  beam  ANNEXE  10  -  OACI 

30  Itoise  (isX  sdott) 


4  NM  =  7  407  m 


BRUITS  DE  FAISCEAUX  LOC  FRANQAIS 
(VALEURS  A  05%) 

t  French  toe  beam  noise 


DISTANCE 


'SEUIL 
DE  PISTE 
runway 


EXTREMITE 
DE  LA  PISTE 
runuay 
end  / 


MODELE  STNA 


DE  PISTE 

runuay 

threshold 


DISTANCE 


Flu, 5  Modules  do  bruits  de  t'uisceuux  LOC 


bruits  oe  faisceau 

X  (2  o) 

T  Loc  beam  noist 


Bl  1 0SOm 
4  NM  -  7  407  m 


CONST  ANTE  DE 
TEMPS  DU  FILTRE 

Filter  \time  consent 


1  SEUIL 
DE  PISTE 
runway 
thrtsnald 


DISTANCE 


D  E  EOOm 


I 

EXTREMITE 
DE  PISTE 

runway 

and 


DISTANCE 


BRUIT  BLANC 


a  **  2.8  mA 


1 

1  +  T.  8 

L 

-  BRUIT  DE  FAISCEAU 

1  SIMULE 

—  "►  'SimuIdkJ  tot  bttm  hoitf 

1  +  0.6 1  [o-2.BmA 

-  AU  SEUIL  DE  PISTE] 

muay  fkrtsJiolJ 


Fig.7  Module  de  bruit  de  faisceau  propose 


U) 

% 

? 

fi 

t _ 

r 

(0 

Ipfi 

i  s 

5  -4-  a 

9 


§is 

p 


Jtitiwy  *Flfi 


Hanoj.  np 


no  ipottu 


U»i)S  =(£ 


de  terrains  des  pistes  de  Toulouse  (FR) 


?/W  jjMJ* 


*OCfrs 

I 


Fig- 1 2  Progiammations  de  la  covariance  du  bruit  LOC  pour  les  difKrents  regjages  du  fUtre 
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This  paper  disouissa  the  rjlevano*  and  us*  of  the  airoraft  model  in  Avlctiic*  Systems  Simulation.  It 
is  often  required  to  study  the  interaction  between  ^laments  of  the  Avionio  3y»tem,  the  vehicle  dynamios  and 
the  outside  world  and  simulation  provides  a  useful  and  oost-effeotive  method. 

Modelling  of  the  outside  world  forma  an  essential  part  of  any  simulation  and  it  is  important  to  aohlsve 
a  representation  whioh  is  compatible  with  the  objectives  of  the  simulation.  The  outside  world  ie  considered 
to  be  that  part  of  the  simulation  with  whioh  the  system  interaots  to  perform  its  function  and  a  dear  dis¬ 
tinction  should  be  made  between  the  operational  system  and  the  outside  world.  An  example  is  inoluded  to 
Indicate  the  importance  of  making  this  distinction.  In  general)  the  simulation  objectives  determine  whether 
the  airoraft  forms  part  of  the  outside  world  or  part  of  the  operational  system. 

The  airoraft  model  is  disousssd  in  depth,  to  indicate  the  choice  to  be  made  in  determining  the  level 
of  complexity  required  to  fulfil  differing  objectives.  Aircraft  models  of  different  types  are  deuoribed. 

Somo  algorithms  and  solution  techniques  are  presented  along  with  an  indication  of  the  limitations  inherent 
in  the  models. 

Two  contrasting  simulations  are  then  discussed  in  detail  to  show  the  significance  of  tha  aircraft  model 
in  relation  to  the  avionio  syst.am  simulation.  The  first  example  illustrates  the'  use  of  an  airoraft  modal 
in  a  CP  computer  simulation  of  the  interception  of  invading  aircraft.  Thu  second  example  disonasea  the 
airoraft  model  uaod  in  a  pilot-in-the-loop  real-time  simulation  of  the  avionics  oyatem  for  an  attaok  airoraft. 
In  both  examples  practical  considerations  are  inoluded  such  as  prooessor  requirements  and  simulation  system 
arohiteoture. 

1.  INTRODUCTION 

The  application  of  simulation  to  avionios  systems  haB  traditionally  oonoentrnted  on  the  development  of 
flight  control  systems  and  of  flight  deck  simulators  for  the  training  of  airline  pilots,  These  application* 
are  ae  lmpo-tant  now  as  ever  beoause  of  the  use  of  aotive  oontrolu  for  flight  control  syatems  and  beoaueo 
of  the  necessity  to  reduce  pilot  work-load  particularly  during  the  landing  and  take-off  phases  of  flight  in 
orowded  airspaoe  and  during  handling  emergencies. 

However,  in  recent,  years,  inoreouing  complexity  of  avionics  ey  ,eme  coupled  with  the  higher  level  of 
integration  of  aysteme  and  the  increasing  use  of  software  Instead  o1'  hardware  to  define  the  eyntems  have 
led  to  muoh  wider  application  of  simulation.  Some  of  the  problems  for  whioh  simulation  techniques  oan  be 
applied  include  i- 

1)  Flight  deck  and  cookplt.  ergonomio  deoign  auBeBBment 

2)  Avionic  system  integration  and  deBtgri  verification 

3)  Software  and  hardware  proving 

b)  Operational  and  effectiveness  studies 

5)  Pilot  training,  both  oivil  and  military 

Different  levels  of  simulation  are  appropriate  depending  on  the  intended  objectives  e.g.  weapon  aiming 
otudieH  require  I 

(i)  General  purpose  computer  simulation  modelling  of  the  scenario  to  test  concepts  and  establish 
first  order  parameter  values. 

(ii)  Fixed  and  moving  baBe  simulation  to  demonstrate  pilot  aooeptibility . 

(ill)  Syotem  olmulation  to  auuiet  in  tha  design  and  verification  of  the  ByBtom  arohiteoture  and  to 
onaure  integration  with  the  total  avioii's  ByBtom.  Of  particular  vulue  is  the  ability  to 
design  sub-nytitem  software  and  to  demonstrate  Its  oompatability  with  the  total  system  require¬ 
ment. 

When  designing  a  eimul  .tlon  activity  it  lo  important  to  develop  a  clear  under-standing  of  th  simulation 
objectives  prior  to  the  design.  Experience  has  Bhown  that  failure  to  do  this  at  the  ouloet  oan  result  in 
large  uoale  modifications  being  incurred.  Any  attempt  to  uee  a  simulation  designed  around  one  set  of  objeo- 
tlvou  often  leads  to  time  consuming  changes  to  Batiefy  a  new  set  of  objectives.  However,  over  the  life  of 
a  large  scale  simulation,  objective!)  oan  change  for  a  variety  or  reasons  and  un'iesB  adequate  provision  has 
been  built  Into  the  original  deulgn  a  stage  in  reached  when  It  Ip  cost  effective  to  otart  again.  Perhaps 
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the  most  successful  approaah  to  achieving  a  simulator  to  satisfy  a  wide  ranging  tst  of  objnativtu  is  the 
use  of  a  modular  oonstruotion  of  the  software  design  with  the  interfaces  between  the  components  being  as 
simple  as  possible  and  olearly  sjecifieu. 

2.  OUTSIDE  WORLD  SIMULATION 

It  is  often  required  to  study  the  interaocion  between  elements  of  an  avionlo  system,  the  vehicle 
dynamioo  and  the  outside  world  and  henoe  it  is  necessary  to  embed  the  system  simulation  within  environmental 
models.  The  overall  environmental  simulation  includes  validated  models  of  airframe,  scenario  geometry  and 
atmosphere  eo  that  the  system  under  test  can  reoeive  realistic,  signals  and  produce  results  that  oan  be 
aoouratsly  assessed  for  functional  performance.  Under  differing  circumstances  tne  airoraft  may  form  part 
of  the  system  simulation  or  part  of  the  outside  world  representation  depending  on  the  simulation  objectives. 
The  ou. side  world  has  been  assumed  to  be  that  part  of  the  simulation  with  whioh  the  system  to  be  studied 
interaots  to  perform  its  functions.  A  alear  distinction  should  be  made  between  the  operational  system  and 
the  outBide  world  as  the  following  example  illuetrateo.  This  example  is  an  extreme  case  but  it  eervaB  to 
demonstrate  the  importance  of  establishing  olear  objectives  at  the  outset  and  hence  a  satisfactory  simula¬ 
tion  design. 

The  simulation  on  a  general  purpose  oomputer  of  a  navigation  technique  for  airborno  veliiolas  is  des¬ 
cribed  by  ,T.  W.  Lyons  et  al,  1975  (ref,  l).  The  navigation  method  uses  correlation  between  ter-rain  data 
as  stored  in  the  vehiole  proosssors  and  terrain  data  as  measured  by  the  vehiole  semorB  (ranging  laser  and 
radio  altimeter).  For  the  simulation  it  is  necessary  to  provide  a  representation  of  the  terrain  over  whioh 
it  is  intended  to  fly  and  whioh  is  assumed  to  be  part  of  the  SYSTEM  i.e.  the  terrain  data  stored  in  the 
vehiole  processor.  It  is  also  necessary  to  provide  a  separate  terrain  representation  as  part  of  the 
OUTSIDE  WORLD  simulation  and  whioh  is  sampled  by  the  vehiole  sensors  (figure  l).  Olearly  it  ia  essential 
that  within  the  simulation  the  two  requirements  for  a  terrain  representation  are  maintained  oonoeptually 
distinct.  This  was  aohieved  by  setting  up  a  basic  terrain  data  base  in  the  form  of  height  ordinates  at 
points  on  a  rectangular  grid  with  100  metre  spacing.  This  formed  the  basiB  of  the  outside  world  terrain 
representation  with  interpolation  used  to  provide  a  smooth  analogue  representation.  Ono  of  the  objectives 
of  the  simulation  was  an  investigation  of  the  nature  of  terrain  representation  that  would  be  appropriate 
for  the  vehiole  processors  to  satisfy  the  navigation  requirements,  The  method  used  a  reotangular  grid 
system  with  height  ordinates  stored  at  1.90  metre  intervals,  although  200  metre  intervals  were  found  to  bn 
satisfactory.  These  height  ordinates  were  derived  from  the  interpolated  outside  world  data  base  after  it 
had  beer,  drawn  in  contour  form.  In  this  way  the  email  errors  incorporated  in  translating  from  ths  real 

world  to  the  vehiole  processor  data,  using  standard  surveying  techniques,  were  inoluded  in  the  simulation. 

Henoe,  a  olear  distinction  between  the  outside  world  simulation  and  the  system  simulation  was  aohieved. 

3.  AIRCRAFT  MODEL 

As  stated  previously  the  airoraft  may  form  part  of  the  system  simulation  or  part  of  the  outside  world 
representation.  The  examples  to  be  disousBed  show  ite  use  as  part  of  the  outBide  world  when  evaluation 
of  an  airoraft  coakpit  is  oonsidered  and  ae  part  of  the  system  when  the  effectiveness  of  the  total  airoraft 
aonoept  (with  the  avionics  as  part  of  that  oonoept)  is  considered,  While  the  simulation  arohiteoture  is 
influenoed  by  this  distinotion,  the  basio  modelling  of  the  airoraft  flight  dynamics  is  not.  The  model 
itself  oan  be  oonoidered  to  be  a  module  within  the  simulation.  The  model  may  be  hoBted  within  a  general 
purpose  processor  whioh  serves  the  total  simulation  or  it  may  be  separate  from  other  elements  of  the  simu¬ 
lation  by  adopting  a  federated  processing  system.  The  choice  will  depend  on  the  nature  of  +he  simulation, 

the  type  of  prooesBor(s)  available  and  other  10"al  oonutraints. 

In  designing  an  aircraft  model  to  meet  the  needs  of  a  partioular  application,  the  objectives  of  the 

simulation  should  first  be  assessed  to  determine  the  degree  of  complexity  required.  Aircraft  models  oan 

vary  from  a  simple  moving  point  in  space  exhibiting  properties  suoh  as  radar  cross-section,  or  infra-red 
signature  up  to  a  full  representation  in  whioh  the  properties  of  the  airframe,  power-plant,  systems, 
weapons  and  pilot  are  modelled  as  olossly  as  possible.  The  simplest  airoraft  models  are  useful  for,  Bay, 

modelling  of  a  total  defence  system  in  whioh  the  operation  of  fleets  of  airoraft  are  simulated.  The  simu¬ 
lation  objeotiveB  could,  for  example,  oall  for  the  primary  effort  to  be  expended  on  the  siting  and  propertiee 

of  the  air  defenoe  radar  environment,  and  only  the  maorosoopio  aspects  of  aircraft  operations  covering 

some  hundreds  of  square  kilometers  are  required  to  obtain  valid  results. 

The  most  complete  mathematical  description  of  the  airoraft  is  required  in  simulations  involving  direct, 

real-time,  human  interaction  e.g.  in  tho  cockpit  environment.  Flight  simulation  of  existing  aircraft  is 
already  a  commonplaoe  reality,  but  the  simulator  may  also  be  used  an  a  design  tool  to  establish  acceptable 
pilot  workload  levels,  explore  handling  oharaoteristioB  of  project  airoraft,  refine  properties  of  active 
oontrol  systems  and  to  design  new  oookpit  layouts  with  head  up  displays,  novel  oontrol  mechanisms,  ewitoh- 
able  C.R.T.  displays  and  digital  data  highway  systems. 

Before  considering  suoh  applications  in  more  detail,  however,  a  brief  indioatlon  is  given  of  the 
mathematical  description  of  the  aircraft. 

The  model  itself  ia  based  on  the  solution  of  a  set  of  simultaneous  non-linear  differential  equations 
whioh  are  used  to  describe  the  airoraft  flight  dynamics.  These  equations  will  bo  an  approximation  to  the 
physical  reality  with  the  simulation  requirements  determining  the  nature  of  the  approximations  which  are 
acceptable  and  the  method  of  solving  the  equations. 

When  dlsouBBing  the  modelling  of  the  airoraft  in  relation  to  its  use  in  avionio  simulations  it  is  usually 
a  requirement  to  embed  a  representation  of  the  airoraft  flight  dynamics  within  a  total  oontrol  system,  In 
this  way  ths  total  airoraft  response  to  pilot  inputs  is  modelled.  Then  the  aircraft  flight  dynamics  are 
represented  by  a  transfer  function  in  a  blook  diagram  of  the  oontrol  syotern.  The  study  of  oontrol  systems 
and  their  representation  In  simulation  ie  a  vast  topio  and  is  not  disoussed  in  depth  here.  The  Intention 
is  to  indicate  the  method  of  obtaining  the  airoraft  transfer  function  by  defining  the  stability  derivatives 
whioh  relate  the  ohangeB  in  the  aerodynamio  foroes  and  moments  acting  on  the  airoraft. 
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It  is  firstly  necessary  to  define  an  axis  Byutom  and  while  a  number  of  axis  systems  could  be  chosen 

it  Is  conventional  to  define  a  system  with  its  origin  at  the  oentre  of  gravity  of  the  aircraft  and  its 

axes  fixed  either  to  the  aircraft,  in  order  to  avoid  moments  of  inert  i  a  whi  oh  ohttnge  with  time  -  the  Principal 
Body  .Axes  -  or  to  the  instantaneous  flight  vector,  'l'hio  latter  ohoioe  lo  the  so-i. tilled  Aerodynamic  Body  Axes, 
an  orthogonal  right-handed  triad,  in  which  the  x  axis  lies  along  the  instantaneous  veloolty  veotor  with 
the  y  axis  along  the  starboard  wing  and  the  z  axis  downward  as  seen  by  the  pilot.  It  should  be  noted  that 
in  general  the  x  axis  is  not  aligned  with  the  longitudinal  axis  of  the  aircraft  but  at  some  angle,  a, 

ffor  small  porturbation  models  an  axis  system  is  usually  ohoaen  whioh  is  initially  aligned  with  the 
aerodynamic  body  axes  at  the  start  of  the  perturbation,  and  remaining  fixed  relative  to  the  aircraft  body 
during  the  perturbation.  This  axis  system  has  bean  called  "Stability  Axes." 

Thu  equations  of  motion  are  obtained  by  applying  Newtone  laws  of  motion  and  in  general  it  is  possible 
to  make  a  number  of  simplifying  assumptions  although  their  validity  will  depend  on  the  applioationi 

1)  It  is  usually  safe  to  assume  that  the  x  and  z  axes  lie  in  a  plane  of  symmetry  of  the  airoraft. 

2)  It  can  be  assumed  in  general  that  for  the  short  period  of  time  that  is  relevant  to  a  dynamio 

analysis  the  mass  of  the  airoraft  remains  constant.  Clearly  thtB  is  not  valid  at.  and  for  a  short 
time  after  weapon  releaso  and  if  the  behaviour  of  the  airoraft  at  this  time  is  an  important  con¬ 
sideration  this  simplifying  assumption  cannot  be  made. 

3)  It  is  assumed  for  simulation  purposes  that  the  airoraft  is  a  rigid  body  although  again  the  validity 
of  this  assumption  is  dependent  on  the  objectives  of  the  simulation  e.g.  harmonisation  of  the 
radar  and  E.O.  sensors  with  the  HUD  and  inertial  sensors  requires  to  take  aooount  of  struotural 
bonding. 

1,)  It  is  assumed  that  the  earth  is  an  inertial  reference  with  the  atmosphere  fixed  with  reBpeot  to 
the  earth.  This  aseumption  is  not  valid  for  thB  analysis  of  inertial  guidance  systems  but  is  for 
the  analysis  of  control  systems  and  greatly  simplifies  the  final  equations. 

It  can  be  shown  that  by  applying  Newtons  Laws  it  requires  uix  simultaneous  non-linear  equations  of 
motion  to  completely  deBoribe  the  behaviour  of  a  rigid  airoraft.  These  equations  give  a  full  force  and 
moment  balance  acting  on  the  airoraft.  Suoh  equations  can  be  found  in  olassioal  literature  but  the  form 
required  for  any  application  to  airoraft  model  use  depends  upon  the  axiB  system  which  1b  ohosen, 


Examples  of  the  two  types  of  airoraft  model  follow.  The  firBt,  1b  a  small  perturbation  model  whioh 
uses  full  aerodynamic  stability  derivatives  but  tn  two  dimensions  only,  whilst  the  second  is  a  full  three 
dimensional  model  but  using  a  simplified  approach  to  the  treatment  of  dynnmio  response  of  the  airoraft. 

In  the  simplest  aaae,  where  the  requirement  is  for  a  2-dlmensional,  small  perturbation,  linear  model, 
tho  equations)  of  motion  oan  be  written  in  the  form  i- 
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H  forward  force  derivatives 
=  normal  force  derivatives 
=  pitching  moment  derivatives 


=  pitching  moment  derivative  due  to  elevator  deflection 
x  =  "non-dimensional"  time  W 

£(M 

V  =  equilibrium  aircraft  velocity 
u 

M  =  “  aircraft  density  ratio 

g  =  acceleration  due  to  gravity 
Uj  =  Lift  coefficient 


B  S  moment  of  inertia  about  y-  axis 
1  5  tail  moment  arm 


S  S  aircraft  reference  wing  area 
W  s  current  aircraft  weight 


The  aeeutnptions  made  in  arriving  at  these  equations  are  l- 
(i)  disturbances  are  small,  about  the  equilibrium  condition 

(ii)  the  product  of  variations  oan  therefore  be  neglected  oompared  to  the  variations 

(ill)  small  angle  assumptionn  are  valid  for  angles  between  the  equilibrium  and  disturbed  axes 
(iv)  tho  x  axis  is  aligned  with  the  velocity  vector  while  the  airoraft  is  in  equilibrium  flight 

Theee  equations  have  been  used  in  the  simulation  of  a  simple  terrain  following  system  where  the  objec¬ 
tive  was  the  study  of  the  terrain  following  control  system  in  the  pitch  plane.  In  such  a  simulation  the 
effects  of  turning  flight  have  to  be  oonsidered  independently. 

For  many  simulations  a  small  perturbation  model  will  not  be  adequate.  It  will  be  neoeesary  tu  simulate 
the  full  aerodynamlo  effects  and  engine  performance  effects.  Examples  of  suoli  simulations  are  described  in 
Sections  k  and  5.  In  partioular  the  airoraft  differential  equations  used  with  the  close  oombat  model  are 
given  below. 

This  model  uses  the  Euler  system  to  define  the  angles  in  space,  and  makes  use  of  both  the  Principal 
Body  AxIb  (p.B.A.)  and  the  Aerodynamic  Body  AxiB  (A.B.A.)  systems  in  order  to  define  the  etate  of  the  air¬ 
oraft  fully. 

(T  cos  a  -  D  _  a) 
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where 


X  ■  V  cos  0  cos  T 

Y  «  V  cos  0  sin  ¥ 

h  ”  V  sin  0 

q  »  K3  (qD  -  q)  cos8  a 

w  «  T  (-  sfc) 

where 

r  ■  g  cos  8  cos  4 
V  cos  a 

p  *  p  cos  a  +  r  sin  a 
w 

r  ■  r  cos  a  -  p  sin  a 

q  *  g  (T  sin  «  +  L  -W  cos  0  cos  t)  ■ 
w  W.  V 

L  -  i  p  V8  S  0, 
u 

L  max  “ip  V8  S  CL  max 
D  -  i  p  V8  SCD 

T  =  engine  thrust  at  current,  throttle  setting 
V  5  velocity 
p  5  roll  rate 
q  =  pitch  rate 
r  c  yaw  rate 
a  5  angle  of  incidence 

0,  $,  iji  =  angle  of  pitch,  bank  and  azimuth  in  principal  body  axes 
0,  'f  =  angle  of  pitch,  bank  and  azimuth  in  aerodynamic  body  axes 
X,  Y,  h  =  position  in  earth  axes 
W  =  aircraft  weight 

subscript  'w1  denotes  variables  in  aerodynamic  body  axes. 


These  equations  make  use  of  the  following  assumptions  i- 

(i)  There  is  no  appreciable  eideslip 

(ii)  Values  of  ,  R,,  and  can  be  specified  for  all  Maoh  numbers,  altitudes  and  'g'  loadings 

(iii)  The  functions  i 

T  -  engine  thrust 

D  -  alrornl't  drag  (or  in  coefficient  form) 

sfo  -  engine  Bpeaifio  fuel  consumption 

C|  -  lift  coefficient 

max  -  maximum  usable  lift  coefficient 

can  be  specified  in  tabular  form  with  sufficient  accuracy  to  give  a  good  representation  of  the  vehtole 
properties,  These  functions  are  allowed  to  vary  with  the  following  independent  variables  ae  requirsdl 
Maoh  number,  Altitude,  a  ,  0,  ,  and  ISngine  throttle  setting. 

A  similar  set  of  equations  haB  been  used  with  the  oookpit  simulation.  A  matrix  approach  was  ohosen 
for  the  description  of  the  aircraft's  aerodynamio  oharaoterlstios.  One  of  the  important  but  tims-oonBuming 
tasks  when  setting  up  a  simulation  is  in  describing  the  aircraft  parameters  in  a  oonvenient  form  and  einoe 
the  extensive  programming  existed  the  inevitable  overhead  associated  with  the  matrix  approach  was  aooepted. 
The  method  produced  u  full  non-linear  model  whioh  combined  the  convenience  of  a  matrix  description  of  the 
aerodynamics  with  the  efficiency  with  whiah  a  conventional  numerical  integration  can  present  non-linear 
phenomena.  ThiB  was  aohioved  by  representing  the  aircraft  rigid  body  dynamios  using  a  conventional  nuraer- 
ioal  integration  teohnique,  thereby  reducing  the  frequency  with  which  the  syutem  description  matrix  needed 
re-evaluating.  B'igure  2  shows  the  program  structure. 
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SOLUTION  OP  THE  AIRCRAFT  EQUATIONS 

In  general,  the  requirement  le  to  solve  the  set  of  first  order  simultaneous  differential  equations 
whioh  describe  the  six  degrees  of  freedom  of  the  airoraft  motion.  Ideally  a  method  of  solution  ie  sought 
whioh  converges  rapidly,  requires  a  minimum  of  oomputer  storage  spaoe,  ie  simple  to  sxeoute  (i.e.  does  not 
require  the  computation  of  higher  derivatives)  and  provides  rtadily  obtainable  sstimatss  of  the  errors  in¬ 
volved.  While  there  are  a  number  of  possible  methods,  thsre  are  none  available  which  satisfy  all  these 
desirable  oharaoteristios.  The  most  oommonly  used  approaoh  is  ths  use  of  one  of  the  various  Rungs-Kutta 
methods.  They  all  have  the  distinguishing  properties  that 

1.  they  are  one  step  methods  i.s,  ths  solution  is  obtained  by  using  the  values  of  ths  variables  at 
ths  previous  point  only.  Hsnas  they  oan  be  ooneidsred  ae  self  starting  techniques. 

2.  thay  do  not  require  the  evaluation  of  any  of  the  derivatives,  but  only  ths  funotione  themselves. 
However,  it  is  necessary  to  evaluate  ths  funotione  for  mors  than  one  value  within  ths  step  width. 
Essentially  this  ia  the  trade-off  involved  in  avoiding  the  evaluation  of  higher  derivatives. 

One  of  the  major  disadvantages  of  ths  Runge-Kutta  methods  is  ths  laok  of  a  simple  meann  for  estimating 
the  errors.  Without  soms  measure  of  the  truncation  error  it  is  diffioult  to  ohoose  a  suitable  step  else 
over  whioh  to  oarry  out  the  integration.  An  estimate  of  ths  truncation  errors  oan  bt  obtained  with  additional 
□omputing  but  in  praotioe  ths  step  width  is  often  ohosen  on  a  trlal-and-error  basis  and  oonstralnsd  by  ths 
oomputing  time  available  to  aohieve  a  eolution. 

The  most  oonvenient  Runge-Kutta  method  for  this  application  has  been  found  to  be  a  fourth  order  method. 
The  equations  are  solved  over  the  ohosen  time  interval,  than  using  half  the  interval  and  the  solution 
checked  for  oonvergenoe.  If  adequate  sonvergenoe  Is  not  aohieved  the  interval  la  again  halved  and  the 
equations  solved.  The  prooesB  is  repeated  until  adequate  oonvergenoe  is  achieved  or  oomputing  time  for  ths 
operation  is  exhausted, 

It.  INTERCEPTION  SIMULATION 

As  an  illustration  of  the  selection  and  use  of  appropriate  airoraft  models  for  simulation,  two  con¬ 
trasting  examples  have  been  ohosen.  The  first  of  these  illustrates  the  use  of  airoraft  models  with  different 
degrees  of  oomplexity,  and  also  it  illustrates  how  the  definition  of  outside  world  varies  with  ths  definition 
of  the  objectives. 

The  problem  ia  to  predict  ths  efftdenoy  of  a  defence  system  when  faoed  with  an  opposing  invading  force 
entering  the  airspace  whioh  is  to  be  defended.  A  full  simulation  using  actual  equipment  la  often  the  sub- 
jeot  of  N.A.T.O.  exeroioes,  and  olearly  an  extremely  expensive  undertaking. 

further,  a  full  digital  simulation  of  a  defenoo  system  as  a  whole  is  •xpensive  -  even  if  a  large  ded¬ 
icated  oomputer  system  oould  be  made  available  to  run  such  a  simulation.  A  more  oost  effeotive  approaoh 
is  to  split  the  simulation  into  manageable  portions,  analyse  the  oritioal  elements  in  any  particular  portion, 
and  then  reconstitute  the  interoeption  from  the  constituent  partB.  The  airoraft  model  is  tallorod  to  the 
mast  appropriate  form  for  eaoh  portion  of  the  simulation, 

The  simulation  of  an  interoeption  oan  be  said  to  oovsr  three  phases  i 

(i)  The  acquisition  of  ths  enemy,  followed  by  tbs  take-off  (if  not  on  C.A.P.),  olimb/deeoend  to 
height  and  aoosleration, 

(ii)  The  vectoring  phase 

(iii)  The  engagement. 

The  first  phase  tends  to  be  a  separate  problem,  and  gives  the  Initial  distance  covered  and  fuel  used 
in  gaining  the  desired  height  and  speed  (Reference  3). 

In  phase  two,  the  airoraft  tends  to  be  at  some  oruise,  or  steady  state,  operating  at  moderate  'g'  levels. 
It  is  the  veotoring  aspects  whioh  are  under  olose  scrutiny.  Accordingly  We  can  use  an  airoraft  model  which 
le  simplified  to  use  only  parameters  sffesting  perf ormanoe .  These  parameters,  generally  supplied  as  a 
function  of  speed  and  altitude,  inolude  fuel  consumption,  maximum  turn  rates  and  maximum  aoosleration  rates. 

It  1b  the  acquisition  radar  systems  and  ths  communications  to  the  interceptors,  in  an  E.O.M.  environment, 
whioh  are  under  investigation  whsther  they  are  ground  based  (O.C.I.),  airborne  (A.BI.W.  or  A.W.A.O.S.)  or 
intoroeptor  mounted  (c.A.P.).  The  simulation  is  particularly  aimed  at  finding  out  how  the  errors  in  the 
acquisition  systems  affeot  the  suooese  or  otherwise  of  the  interoeption  as  a  whole.  These  errors,  generally 
in  some  gLvcn  deterministic  or  stochastic  form  oooapy  the  major  effort  in  the  simulation,  and  it  oan  be  sten 
that  the  airoraft  model  for  both  target  and  interceptor  oan  be  quite  simple  without  affecting  the  validity 
of  the  model. 

Results  or  a  typioal  simulation  ars  shown  in  Figure  (3),  which  show*  the  interoeption  of  an  intruder 
whioh  oan  choose  to  weave  or  to  press  on  with  the  attank  by  flying  straight  and  level.  Ths  figure  shows  a 
time  history  of  the  interoeption  from  the  initial  take-off  to  the  final  kill,  giving  major  parameters 
(fuel,  speed,  altitude)  at  key  pointe  of  the  trajectory. 

The  veotoring  phase  of  the  engagement  oan  be  Bald  to  end,  either  on  release  of  long/medium  range 
missiles,  or  at  ths  start  of  the  engagement,  whioh  can  be  close  combat,  if  the  target  airoraft  have  that 
inclination  or  deuial-of-eaoape  combat  should  the  target  attempt  to  disengage.  The  former  requires  an 
extensive  missile  program  for  continuation,  whereaB  the  engagement  requires  a  model  with  full  description 
of  the  aircraft.  The  requirements  for  the  airoraft  model  in  close  oombat  will  be  considered  in  more  detail. 
Denial-of-escape  simulation  needs  eimilar  aircraft  modelling,  but  with  the  emphaBis  on  missile  parameters 
rather  than  airoraft  parameters.  The  modelling  of  miseile  flight  and  kill  probabilities  merits  considerable 
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attention  in  its  own  right. 

Here  the  emphasis  is  oil  the  airoraft  model.  The  complexity  demanded  by  olose-oombat  simulation  is  auoh 
that  the  motion  of  the  airoraft  in  space  should  be  very  fully  represented,  a.nd  the  simulation  incorporates 
a  mathematical  representation  of  aerodynamio  properties,  engine  capabilities  as  well  as  airborne  interoeption 
radar,  pilot  and  airoraft  'g'  toleranoe  and  weapon  kinematio  and  acquisition  boundaries. 

Figure  (U) ,  shows  the  airoraft  model  part  of  a  oloso  ooabat  simulation  program.  The  model  operates 
by  integrating  the  non-linear  differential  equations  over  a  finite  time  interval  using  the  olassioal  Runge- 
Kutta  proosss. 

The  information  available  from  this  process  will  include  those  variables  in  Section  3  end  in  each  oast, 
their  derivatives  with  respect  to  time  will  also  be  available  for  use  in  other  modules  of  the  program. 

The  tactics  routines  operating  to  given  desision  rules  determine  the  aooeleration  components  input 
to  the  airoraft  model.  The  response  is  determined  by  the  airoraft  model,  whioh  also  applies  limits  of  air¬ 
oraft  and  pilot  performance  when  necessary. 

There  are  also  the  basic  properties  of  the  airoraft  and  weapon  system,  supplied  as  data,  These  include  I 

Full  engine  performance,  thrust  and  fuel  consumption 

brag  polars  for  the  aircraft 

Lift  characteristics  ( including  limiting  values) 

'  Structure  limits. 

These  are  supplied  in  tabular  form,  with  the  variation  with  Maoh  number  and  altitude  predetermined. 

Pilot  'g1  toleranoe  is  also  modelled  as  a  function  of  time. 

The  sensors  aboard  the  airoraft  -  inoluding  the  pilot's  own  eyes  -  supply  the  information  to  the  tao- 
tioe  modules  which  in  turn  drive  the  airoraft  model.  Henoo  they  ehould  be  simulated  adequately,  so  that 
the  information  weed "by  each  airoraft  in  the  combat  -  whioh  may  inolude  the  simulation  of  errors  in  the 
system  -  1b  representative  of  that  used  for  taotioal  decisions  and  reflects  air  foroe  praotioe,  (in  faot 
the  taotioe  used  often  present  the  principal  problems  to  the  modeller).  This  information  oan  inolude 
the  following  parameters,  whioh  may  be  used  with  or  without  error  simulation  i  Range,  Look  Angle,  Aepeot 
Angle,  Sight  Line  Spin. 

Again,  in  eaoh  cane,  derivatives  with  reepeot  to  time  are  available.  Variables  may  only  be  need,  of 
course,  when  it  is  oonoiderad  they  are  available  to  the  pilot  in  following  thB  deoieioh  rules. 

In  a  similar  way,  the  flight  of  a  missile  or  Bhell  oan  bs  modelled  to  oomplete  the  interoeption  sim¬ 
ulation  at  the  kill  (or  mlssl)  in  whioh  case  the  miBsile  on-board  B-0  equipment  may  be  modelled  to  a  similar 
level, 

The  total  simulation  operates  as  a  'M'  against  ' N •  oonteEt,  in  whioh  'M'  airoraft  of  one  side  'fly' 
against  'N'  airoraft  of  the  other  side,  where  both  'M '  and  'N'  are  necessarily  small  number*,  less  than 
10,  Bay.  Haoh  of  the  airoraft  makes  a  'move',  i.e,  makes  a  taotioal  deoision  on  how  to  move  based  on  hie 
knowledge  of  the  Btate  of  oombat,  and  is  moved  aooordingly  by  the  numerloal  integration  process  over  a 
single  time  Btep,  All  aircraft  move  to  complete  one  round,  and  the  process  is  repeated  until  a  time  limit, 
or  winning  Bide  appears.  This  is  shown  in  Figure  (5), 

The  decision  rules  built  into  oloss  oombat  models  are  taken  from  a  consensus  of  opinion  of  servioe 
pilots,  projection  of  trends  and  experience  from  using  the  model. 

Full  input  data  for  the  airoraft  as  described  previously  are  required  to  run  Buoh  a  simulation,  with 
the  addition  of  a  oomplete  description  of  initial  starting  geometries,  und  data  to  define  the  deoision 
rules. 


The  weapon  data  are  supplied  as  a  table  of  launch  suooess  zones  (L.S.Z.)  again  as  a  function  of  Maoh 
number  and  altitude,  and  also  target  'g',  (it  will  be  noted,  however,  that  a  weapon  launohed  within  a 
L.S.Z.  need  not  necessarily  bs  suooeBiful,  due  to  target  evasive  manoeuvre  during  the  flight  time  of  the 
missile.)  Acquisition  zones  are  treatid  similarily.  Gun  capabilities  are  also  modelled.  Single  shot  kill 
probabilities  are  assigned  to  eaoh  type  of  weapon  fitted.  This  faotor  is  oruoially  important  for  deoiding 
when  a  kill  has  oootured  and  henoe  when  a  oombatant  is  removed  from  the  engagement. 

Figure  (6)  shows  a  plan  view  of  a  typical  engagement. 

To  fully  simulate  an  interoeption,  separate  programe  covering  all  phaeee  may  be  put  together  sequen¬ 
tially  to  obtain  full  Interoeption  simulation  sb  shown  in  Figure  3.  This  gives  a  mean*  of  studying  the 
degree  of  suooess  of  the  dofenoe  system  in  intercepting  intruders,  and  oan  help  to  nigh-light  where  there 
ara  particular  deficiencies  in  performance, 

The  interception  programs  oan  help  both  the  airoraft  manufacturer  and  the  defence  scientist  to  tailor 
future  airoraft  to  the  needs  of  the  defenae  system  given  a  predicted  level  of  threat.  Parametria  variations 
of  important  variables  -  in  airoraft,  weapons  or  avionio  systems,  for  example  -  are  possible, enabling  the 
programs  to  be  used  as  a  design  tool, 

5.  COCKPIT  SIMULATIOH 


Thie  simulation  illustrates  the  most  complex  application  of  the  airoraft  model,  with  the  inoluBion  of 
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a  pilot  in  the  loop. 

It  oonoems  the  design  of  a  single  seat  fighter  oookpit.  Here  the  requirement  is  to  layout  the  oookpit 
faoilitiea  in  euoh  a  way  that  the  pilot  oan  fulfil  the  mission  tasks.  ThiB  requires  that  the  pilot  is 
provided  with  Just  the  information  and  controls  that  are  necessary  to  enable  him  to  oarry  out  the  tasks  re¬ 
quired  of  him.  In  addition  it  is  required  to  teBt  the  oonoepts  developed  and  to  demonstrate  pilot  accep¬ 
tability.  Where  new  faoilitiea  or  funotlona  are  provided  or  where  the  oookpit  departs  radically  from 
ourrent  airoraft  layouts,  it  will  be  neosasary  at  a  later  date  to  familiarise  operational  pilote  with  the 
oonoept*  and  to  provide  a  measure  of  initial  training.  At  the  design  stage  it  will  be  neoeesary  aleo  to 
demonstrate  the  engineering  feasibility  of  the  proposed  arrangement  and  the  integration  of  the  oookpit 
with  the  rest  of  the  operational  and  flight  oontrol  systems,  making  due  allowance  for  the  ocouxrenot  of 
failures  and  errors  within  the  oookpit  or  systems. 

These  are  among  the  reasons  why  it  is  virtually  essential  during  ths  development  phase  of  the  oookpit 
to  use  mookups,  space  models,  simulators  and  system  rigs. 

Traditionally  the  oookpit  ha*  been  designed  very  much  on  an  ad  hoo  bails  with  the  basic  flight  oontrol 
parameter*  being  presented  in  front  of  the  pilot  in  the  conventional  configuration  of  electromechanical 
instrument.  Other  displays  and  oontrol*  have  been  positioned  depending  on  space  available,  the  designers 
personal  prefsrtnc*  and  "we've  always  dons  it  that  way."  OontrolB  and  switches  lave  been  associated  with 
spsolfio  equipments  with  little  attempt  made  to  integrate  or  rationalise  relt'rd  funotlona.  The  result 
oan  best  be  described  as  an  "ergonomio  slum."  The  addition  of  further  systems  c..  . -'difloauior.s  during 
the  life  of  the  aircraft  has  merely  added  to  the  ohaos  and  the  overcrowding. 

Thle  "design"  prooess  may  have  been  adequate  during  the  early  yearB  of  aviation  when  the  .t'aoilities 
that  oould  be  provided  to  assist  ths  pilot  were  limited  and  whtfn  airoraft  speeds  were  more  modest  and  there¬ 
fore  the  pilot  had  mors  time  to  perform  the  miesion  talks.  However,  it  is  clear  that  this  prooess  is 
thoroughly  inadequate  for  the  design  of  a  modern  oookpit.  Technology  allows  us  to  pressnt  the  pllct  with 
far  more  information  and  hence  miesion  tasks  havs  beoome  far  more  demanding.  The  requirement  is  for 
faster  and  move  highly  manoeuvreablt  airoraft.  Henoe  the  pilot  has  less  time  to  oarry  out  the  required  tasks. 
Cockpit  design  thareforo  beoomes  a  muah  more  exact  eoienoe  (Reference  k)  demanding  the  adoption  of  estab¬ 
lished  ergonomic  prinoiples  during  the  design  prooess  and  the  use  of  basic  ergonomio  test  and  measurement 
procedures  during  development.  Only  then  oan  a  near  optimum  presentation  of  information  and  oontrol  fac¬ 
ilities  be  provided  in  the  limited  spaoe  available  and  laid  out  in  such  a  way  as  to  make  the  pilot's  work 
load  tolerable. 

Turing  ths  oookpit  development  therefore,  it  ie  useful  to  cheek  the  basic  configuration  by  constructing 
a  spaoe  model  and  by  introducing  into  the  mookup  basio  pilot  taskB  suoh  as  air-to-air  target  tracking 
using  a  functioning  flight  oontrol  stick  while  requiring  the  pilot  to  perform  normal  in-flight  switching 
tasks.  A  configuration  which  allows  these  tasks  to  be  addressed  is  shown  in  figure  7.  Here  the  airoraft 
model  is  hosted  on  an  analogue  oomputer  which  also  Berves  to  drive  the  target  model.  The  seoondary  task 
is  driven  from  a  small  mioro-prooeasor  unit.  The  advantage  of  using  an  analogue  oomputer  to  host  ths  air¬ 
oraft  model  is  in  eliminating  problems  in  achieving  real  time  response  from  the  model.  However,  muoh 
flexibility  is  lost  and  it  proved  neoesanry  to  use  a  simple  linear  3-D  modal  to  represent  the  airoraft 
because  of  the  diffiaulty  of  updating  the  airoraft  derivatives  during  operation.  During  this  process  a 
first  order  definition  of  the  facilities  which  should  bB  provided  to  the  pilot  is  achieved  by  eliminating 
any  that  are  not  direotly  relevant  to  the  pilot's  deoiaion  making  prooess  or  those  that  would  oertalnly 
overload  the  pilot.  Henoe  we  are  in  the  situation  where  it  is  necessary  to  be  highly  selective  in  the 
fnoilitiew  provided  and  in  the  manner  of  presentation.  If  the  overall  airoraft  design  is  to  be  successful 
it  has  beoome  necessary  to  design  ths  opsrational  systems  from  the  pilot  and  his  environment  outwards 
rather  than  by  ohooslng  the  faoilitiss  whioh  technology  allows  and  hoping  that  the  pilot  will  oope  with 
the  highly  sophisticated  but  srgonomiaally  lmposBible  system. 

The  next  step  in  the  development  ie  the  oonstruotion  of  a  fully  functioning  oookpit  with  meaningful 
outside  world  repreeentation  to  allow  ergonomio  measurement  to  be  made  while  providing  the  pilot  with 
representative  tasks  to  perform.  At  this  stage  it  is  not  possible  to  eliminate  entirely  subjective  opinion 
but,  by  introducing  a  large  number  of  pilots  to  the  oonoept  in  a  Beini-realistio  environment  it  is  possible 
to  obtain  a  satisfactory  pilot  assessment.  In  addition  the  oookpit  simulator  provides  the  basio  faoilitiea 
nooesaary  to  oarry  out  tests  and  measurements.  Obviously  the  degree  of  realism  provided  in  the  simulation 
at  this  stags  should  be  sufficient  to  tempt  the  pilots  to  treat  the  assessment  prooess  seriously,  while 
sufficient  flexibility  should  be  retained  to  allow  modifications  and  adjustments  to  be  made  reasonably 
painlessly.  Clearly  this  stage  of  simulation  requires  the  design  and  programming  of  a  basio  airoraft  flight 
oontrol  system  and  airoraft  modal  to  rspreaent  ths  aircraft,  elements  of  tie  avionic  system  sufficient  to 
oaus*  the  displays  to  reaot  in  a  repreeentative  mann*r  in  response  to  owl '  liing  aotionB  eto.,  and  an  out¬ 
side  world  representation  to  provide  the  pilot  with  meaningful  tasks  against  whioh  to  assess  the  oookpit 
oonoept,  A  possible  advanoed  oookpit  layout  is  shown  in  Figure  6,  The  major  features  shown  include  an 
articulating  seat  and  side  arm  flight  oontroller,  eleotronio  C.H.T.  displays  and  switches  for  ease  of 
aooessibility  along  the  side  consoles.  (Reference  2). 

In  setting  up  the  simulation  syeten  the  airoraft  model  oan  be  ohesen  to  suit  the  assessment  objectives. 
However,  sinoe  the  requirements  will  usually  demand  a  fair  degree  of  realism  a  full  6  -  degree  of  freedom 
non- linear  model  should  bs  adopted.  Then  to  aohleve  the  required  real-time  operation  it  is  neoesBary  to 
consider  carefully  the  speed  of  operation  of  the  hoet  oomputer.  The  mujor  time  consuming  element  is  the 
updating  of  the  airoraft  derivatives  m  the  flight  conditions  change,  The  ohoioe  rests  between  updating 
all  the  derivatives  on  a  periodio  basis  or  checking  the  sensitivity  of  each  derivative  to  change  in  airoraft 
operating  condition  and  updating  only  when  the  derivatives  stray  from  the  allowable  bounds,  ohsoks  being 
oarriBd  out  eaoh  4 rogram  oyole.  It  ts  important  to  avoid  significant  step  changes  in  the  derivatives  which 
give  uneven  feel  to  the  pilot.  For  reasons  of  simplicity  the  former  method  ie  desirable  where  sufficient 
time  ie  available.  It  has  the  dioadvantage  of  being  extravagant  in  time  during  steady  flight  conditions 
sinoe  update  of  the  derivatives  has  to  ba  carried  out  at  a  rate  which  allows  violent  airoraft  manoeuvres 
to  appear  realiatio  to  the  pilot.  Bxperienoe  has  shown  that  when  time  is  at  a  premium  a  suitable  compromise 
ie  to  update  the  sensitive  derivatives  on  a  periodio  basis  and  to  ohook  the  others  at  a  1§bb  frequent  interval. 


For  the  oookplt  simulation  previously  described  the  configuration  used  is  shown  in  Figure  9.  This  shows 
the  use  of  dedioated  mioro-oomputers  to  oarry  out  basic  system  simulation  and  oookplt  interfacing  funotions. 

Further  development  phajes  involve  i- 

(i)  The  UBe  of  a  moving  base  simulator  in  whioh  a  further  stage  of  realism  is  introduced. 

(ii)  The  incorporation  of  the  oookplt  into  a  system  development  rig  to  demonstrate  the  integrity  of 
the  full  oystem  on  the  ground, 

(ill)  An  airborne  oookplt  demonstrator  to  provide  the  final  oonfidenoe  check  and  (hopefully)  minor 

adjustments  before  tho  oookplt  onneept  1b  incorporated  in  the  design  for  a  production  aircraft, 

6.  CONCLUSIONS 

The  paper  has  discussed  the  basio  representation  of  airoraft  flight  dynamioe  for  use  with  avlonio 
simulations.  No  attempt  haB  been  made  to  address  the  separate  issue  of  flight  oontrol  system  simulation. 
Examples  have  been  ohosen  to  illustrate  the  us#  of  varying  levels  of  complexity  of  airoraft  model  and  an 
indioation  given  of  the  simplifications  pOBSibls  for  different  levels.  Clearly  the  oookplt  simulation 
with  a  pilot  in  the  loop,  requires  the  most  oomplex  and  aoourate  representation  of  tho  aircraft. 

It  has  been  shown  that  in  general,  the  simulation  objectives  indioate  the  model  to  be  ohoeen. 
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SUMMARY 


In  the  present  inflationary  economic  environment  there  axiata  a  highly  constrained  defanen  budget  which 
eoveraly  limits  the  acquisition  of  new,  higher  performance  Air  Force  weapon  aystama.  Therefore,  system 
davalopere  cannot  pursue  an  independent ,  open-ended  aaarch  for  maximum  performance.  Naw  weapon  system 
developments  must  now  be  juatlfiad  on  the  basis  of  improved  coat-effactlvsnaas  for  tha  entire  system  over 
its  projected  lifetime.  A  solution  to  this  teak  is  found  in  tha  Avionics  Evaluation  Program  (AEP)  which 
is  a  library  of  aevan  detailed  avionics  performance  assessment  models  all  driven  by  a  common  interactive 
software  package.  The  AEP  provides  an  efficient  means  for  performing  trade-off  analyaae  amoi.g  coat, 
reliability,  maintainability,  and  performance  of  avionic  configurations.  The  program  wee  designed  to  be 
flexible  and  easy  to  use  with  emphasis  on  realistic  consideration  of  the  operational  environment  and  the 
generation  of  useful  data. 

1.  INTRODUCTION 

The  Avionics  Evaluation  Program  is  a  collection  of  avionics  performance  asaaasment  models  developed  for  the 
use  of  the  Air  Forca  Avionics  Laboratory  by  Battalia's  Columbus  Laboratories.  Development  of  the  AEP  was 
motivated  by  the  need  for  a  convenient  and  systematic  method  of  assessing  the  performance  of  avionic  eyetama 
in  tha  mission  environment. 

The  initial  model  development,  begun  in  1969,  concentrated  primarily  on  a  mission  analysis  modal  for  the 
tactical  air-to-ground  role.  Subsequently,  models  for  more  detailed  analysis  of  target  acquialtion,  weapon 
delivery,  tactical  data  link  communications,  and  anti-aircraft  aurvivabillty  ware  added  to  tha  AEP  inter¬ 
active  fre  iwork.  In  1975,  an  air-to-air  veraion  of  thu  mission  analysis  program  wae  developed,  Two 
separata  supporting  programs  have  bean  added  for  deterministic  analysis  of  alr-to-elr  combat,  encounters. 

The  AEP  has  been  designed  to  be  flexible  end  easy  to  uee  with  empheaia  on  the  reallitiq  consideration  of  tha 
operational  environment  and  the  generation  of  useful  date.  The  modular  structure  of  the  AEP  allows  independent 
use  of  the  supporting  models  as  well  as  the  use  of  the  supporting  models  to  generate  date  for  tha  mission 
analysis  program.  The  modular  structure  also  facilitates  the  addition  of  additional  models  and  the 
modification  of  the  models.  In  1973,  the  AEP  was  implemented  in  a  convaraational  interactive  mode  t6  make 
the  collection  of  programs  directly  accessible  to  analysts  with  minimal  computer  programming  experience. 

The  resulting  sophisticated  software  package  has  proven  to  be  e  valuable  asset  in  making  the  modal* 
available  to  a  wide  spectrum  of  uaera  in  government  end  industry, 

2,  Air-To-Ground  Mission  Analysis  Program  (AEP) 

The  AEP  slr-to-ground  mission  analyaia  program  evaluates  performance  of  an  airborne  weapon  system  on  a 
miaolon  which  may  involve  multiple  aircraft  and  multiple  targets.  The  program  evaluatea  tha  operation  of 
a  flight  of  up  to  four  aircraft  for  n  specif  led  number  of  days  of  operation,  including  t'„a  ground  turn¬ 
around  process.  Monte  Carlo  techniques  are  applied  to  reliability  data  for  the  defined  aircraft  equipment 
throughout  the  mieeion  to  determine  which  subsystem  modes  are  functioning — retorting  to  backup  modes  end 
mission  aborts  as  required.  Target  location  uncertainties  and  navigation  system  performance  parameters 
are  combined  to  define  tha  actual  flight  path  relative  to  the  true  target  location.  The  sensor  ground 
swath  for  the  search  pattern  is  than  compered  to  the  truR  target  location  to  determine  if  the  targut  passes 
through  the  sensor  ground  area  coverage.  Probabilities  of  detection,  target  kill  and  aircraft  survival 
are  sampled  to  determine  which  mission  phases  ire  successfully  completed.  The  model  utilises  the  bast  mode 
still  available  for  etch  function  at  the  time  it  is  to  be  performed. 

The  following  steps  are  required  to  eet  up  a  problem: 

(1)  The  mission  must  be  defined  in  terms  of  the  target,  threat,  and  weapons. 

(2)  The  flight  profile  is  defined  using  waypoints  to  describe  flight  segments. 

(3)  A  suite  of  hardwire  (black  boxaa)  describing  the  complete  eircraft  is  itemised ,  Reliability 
and  maintenance  date  are  provided  for  each  black  box. 

(4)  The  required  mission  functions  are  selected  (typical  functions  include  navigation, 
navigation  update,  target  acquisition,  weapon  delivery,  survivability,  communications,  rafueling,  etc.). 

(5)  For  each  function,  the  primary  end  backup  modae  of  operation  must  ba  defined.  A  mode  ie 
defined  by  specifying  the  performance  capability  (if  applicable)  and  assigning  tha  hardware  black  boxes 
required  to  operate  in  that  mode. 

The  output  is  composed  of  statistics  describing  the  mission  events  for  the  selected  number  of  Monte  Carlo 
trials.  The  outputs  Include  targets  destroyed,  mission  aborts,  aircraft  losses,  tsrgsts  detected,  average 
number  of  attack  passes  per  target,  mieeion  costs,  end  e  statistical  summery  of  the  ground  servicing  and 
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maintenance  activitlea. 

3.  Target  Acquisition 

A  comprehensive  set  of  target  acquisition  models  covering  the  unaided  operator ,  TV,  FLIR,  radar,  and 
photographic  cameras  are  available  in  tha  AE?  interactive  eyatem.  The  modela,  grouped  under  the  acronym 
ALSPM  (Avionics  laboratory  Santor  Performance  Modal),  ware  originally  developed  for  tha  Aeronautical 
Systems  Division  at  Wright-Patteraon  AFB,  Ohio  by  Honeywell,  Inc.  Thaee  modela  ware  initially  intended 
for  analysis  of  reconnaissance  sensors  but  are  equally  applicable  to  real  time  target  acquisition. 

In  addition  to  the  computer  models,  there  ii  an  associated  library  of  data  available  from  which  tha  user 
can  solact  descriptions  of  the  target,  scene,  end  cantor .  The  target  le  characterised  by  type  (iaolatad 
element,  linear  array,  or  area  target),  dimensions,  reflectivity,  emieaivity,  or  radar  cross  aaotlon,  as 
appropriate  to  tha  sensor  spectrum.  Similar  data  art  required  for  the  background  in  the  Immediate  vicinity 
of  tha  target,  Scane  data  includa  characterisation!  of  the  weather  and  local  terrain,  Tha  weather  date 
are  uied  to  compute  transmissivity  and  buckicatter  functions.  Tha  terrain  data  are  used  to  compute  tha 
llkalihood  that  lina  of  light  axlata. 

Sensor  data  includa  characterisations  of  lanaaa,  filters,  photoaurf sees ,  electronics,  displays,  film, 
radar  racsivera,  etc,  Tha  data  are  used  to  compute  tha  algnal-to-nolsa  ratio,  targat-to-bankground 
contrast,  and  resolution  ea  viewed  on  a  display  (or  directly  viewed  by  an  observer). 

Tha  modela  C'tsputa  the  likelihood  that  an  observer  can  detect  tha  preaance  of  a  targat-like  objact(e), 
recognise  tha  clasa  of  target  (e.g.,  wheeled  vehicle,  tracked  vehicle,  building),  and  identify  the 
cergat  (e.g.,  T-62  tank,  fuel  truck),  Detection  probability  is  baaed  on  turgat  else  and  contrast,  eignal- 
to-noiee  ratio,  time  in  view,  and  density  of  confusing  objects.  The  human  factor*  model  allow*  selection 
of  three  detection  probability  algorithms— tha  Stathacopoulos  Modal,  the  Williams  Modal,  or  tha  Resell  and 
Wiluon  Modal. 

ALSPM  la  continually  being  updated  to  achieve  more  realistic  assessment  of  target  acquisition  capabilities , 
Tha  FLIR  and  TV  models  have  recently  bean  updatad  to  reflect  the  current  approach  to  tensor  performance 
assessment  and  tha  latest  in  experimental  data.  This  update  includes  transition  to  a  modulation  tranafar 
function  analyeie  of  the  eystam  components. 

4,  Weapon  Delivery 

The  weapon  delivery  analysis  routine  is  a  program  tor  determining  the  distribution  of  impact  errors  for  o 
weapon  eyatem  utilising  unguldad,  unpowered  bomba.  The  modal  ia  a  aingla  program  providing  tor  tha 
evaluation  of  moat  existing  and  future  weapon  delivery  systems.  Tha  program  is  convenient  to  use  with  only 
a  basic  understanding  of  how  a  specific  weapon  delivery  eyatem  operates. 

The  routine  can  be  operated  in  three  nodal! 

(1)  The  user  can  supply  «  weapon  release  algorithm  in  tha  form  of  a  FORTRAN  subroutine  under 
dafinad  guide lines. 

(2)  Tha  Uuer  can  supply  aquations  which  transform  tha  aansor  measurements  into  rectangular 
coordinate  estimates  of  position,  velocity,  and  wind  relative  to  the  target,  Thirteen  system  Implementations 
ueing  this  technique  ere  presently  stored  in  the  program. 

(3)  The  third  mode  requireu  a  uaar-supplisd  FORTRAN  subroutine  duplicating  the  weapon  release 
algorithm  at  in  Mode  1.  This  mode,  however,  applies  to  systems  which  employ  filtering  end  for  which  tha 
uear  chooeee  to  apecify  the  eanaor  errors  in  terms  of  time  varying  magnitude  and  frequency  charactarlatics. 

To  sat  up  a  problem,  the  user  selects  or  defines  an  aircraft,  describes  tha  trajectory,  select*  one  of  the 
stored  weapons,  and  selects  contributing  error  sources.  Contributing  error  source*  which  can  ba  selected 
includa  senior  errors  (e.g.,  air  data  computer,  AHRS,  angle  of  attack,  dopplar,  inertial  system,  radar, 
turgat  tracker),  pilot  errors  (e.g.,  pipper  position,  wind,  sideslip,  bank,  staarlng) ,  computer  errors,  and 
post  release  errors  (e.g.,  release  delay  uncertainty,  ballistic  dispersion). 

Tha  output  la  a  Hating  of  tha  contribution  of  each  error  sourca  to  along-track  Impact  errors  as  wall  as 
tha  statistical  combination  of  all  errors  into  tha  total  probable  miss  distance, 

3.  Survivability 

A  routine  for  analysing  aircraft  survivability  against  antiaircraft  artillery  (AAA)  la  tncorporatad  in  the 
AEP.  Thia  program  developed  by  the  U.S,  Air  Fores  Armament  Teat  Laboratory  (referred  to  aa  AFATL  Program 
P001)  computes  ths  single  shot  probability  of  kill  of  a  target  airrraft.  Consideration  ia  glvan  to  various 
intrinsic  errors  in  predicting  an  eircraf t/projectile  intercept  point.  Computation  of  the  target  aircraft 
attrition  ia  performed  over  an  entire  flight  path  and  the  probability  of  kill  reaulte  for  each  increment  of 
the  flight  path  (single  shot)  are  accumulated.  The  result*  can  be  presented  in  a  graphical  or  tabular 
manner  aa  a  function  of  several  useful  parameters  at  the  option  of  the  uaer. 

The  major  portion  of  the  program  is  concerned  with  the  analysi*  of  all  sourcaa  of  random  error  which 
influence  the  ef fectlveneas  of  the  antiaircraft  artillery.  These  error*  include  prediction  of  an  aim  point 
based  on  the  preeent  behavior  of  the  aircraft,  firing  process  errors,  and  uncertainties  and  perturbation* 
which  arise  externally  to  the  weapon  system.  All  of  these  sources  of  random  error,  uncertainty,  or 
perturbation,  which  In  some  way  contribute  to  enlarging  the  final  distribution  of  projectile  trajectories, 
are  asseused  by  the  program  in  order  to  locate  the  vulnerable  area  of  the  aircraft  within  thia  total 
distribution  of  trajectories  and  compute  a  probability  of  kill. 

Each  ground  weapon  complex  la  described  by  its  location,  number  of  guns,  number  of  barrtla  per  gun, 


projectile  parameters,  and  charactarlatica  of  th*  flra  control  syataa.  Saveral  aata  of  fun  and  projectile 
paraaatara  nay  ba  atorad  for  uaa  In  aubaaquant  analyse*.  Tha  flight  path  la  an  tar  ad  aa  a  aarlaa  of  waypoint*. 
Th*  flight  profile  generator  for  tha  AEP  mission  nodal*  la  u*ad  to  daflna  th*  aircraft  tina  hlatory.  Th* 
targat  aircraft  la  daacrlbad  by  a  tabla  of  vulnarabla  areas  which  ara  function*  of  Impact  angla  and  cloalng 
velocity.  Several  of  thaaa  table*  nay  be  atorad  In  the  interactive  ayatan  for  uaa  In  the  aurvlvabllity 
simulation . 

6.  Communication* 

A  communication*  analytic  nodal  1*  available  for  aaieaeing  tha  likelihood  of  conaunlcatlng  data  ovar 
telemetry)  command-control)  or  wlda-band  video  data  link*.  Tha  routine)  originally  davaloped  for  assessing 
communication  link*  with  ranotaly  piloted  vehicle*  'KPV) ,  la  curran'  ly  being  utilised  for  analyala  of  tha 
vulnerability  of  tactical  data  link*  to  enemy  jamming. 

Tactical  alananta  coneldarad  in  tha  nodal  Include  tna  control  itatlon/alrcraft,  launch  vehicle,  weapon  or 
th*  RPV,  multiple  Jamnara,  and  multiple  enemy  algnal  intelligence  (81GXNT)  atatlona.  For  aach  of  thca* 
alamanta,  tha  uaar  can  apaclfy  typical  parameter*  of  tha  trar.amittara,  racelvari,  modem*,  and  antannaa 
(a.g.,  power,  frequency,  bandwidth,  modulation  typa,  no la*  figure,  loaaaa,  fad*  margin,  antanna  type,  main 
loba  gain,  beam  width,  antanna  dlmanaiona,  front-to-back  ratio).  Charactarlatlc  data  ar*  atorad  for  nunarou* 
antanna  typaa  and  modulation  techniques. 

Tranamiaaion  la  analysad  ovar  two  path*  aa  tha  vahiclaa  mova  along  pradaaignad  flight  prof ilai—  control 
atatlon/aircraft  to  waapon  and  waapon  to  control  station/aircraft.  For  aaoh  path  th*  following 
aaquanca  of  calculation  la  madai  (1)  Fath  lengths,  depression  angles,  off-anglai,  llna-of -eight  existence; 

(2)  Path  loaaatt  (3)  Syataa  gain*  and  loaaaa;  (4)  Carrler-to-noisa  and  carrl*r-to-jam  ratio*  for  friendly 
and  enemy  path*. 

Tha  modal  assumes  that  Janning  can  occur  whenever  Una-of-alght  axlata  to  a  SICINT  station  and  whan  tha 
S1CIHT  atatlon  racaivas  a  signal  a  algnal-to-nolaa  ratio  graatar  than  3db.  Jamming  la  directed  only  at 
tha  aourca  of  signals  received  by  tha  S10INT  stations. 

Th*  modal  output  consists  of  probabilities  of  communicating  Information  ovar  each  data  link  varaua  time  In 
tha  flight  profila, 

7.  Air-To-Air  Mission  Analyil* 

Tha  Alr-to-Air  AFP  miaalon  analyala  program  is  a  Monta  Carlo  simulation  of  two  opposing  aircraft  ftlghta 
(up  to  four  airoraft  in  u  flight)  through  an  antlr*  miaalon.  Aa  tha  flight  progresses,  It  1*  Influenced  by 
hardware  failures,  refueling,  communication*  to  airborne  or  ground  controllara,  enemy  aircraft  datactlon 
capability,  Identification  requirements  and  weapon  capabilities.  Modeling  of  th***  function*  varlc* 
considerably  in  laval  of  detail  baaed  upon  impact  on  miaalon  aucoaaa  and  initial  modal  development  priorities. 
Detailed  visual,  radar  and  infrarad  datactlon  models  era  available  for  tha  targat  datactlon  function. 

Whan  on*  aids  (Rad  or  Blue)  detects  th*  other,  that  flight  pursues  an  appropriate  tactic  and  flrae  whan  tha 
weapon  constraints  are  satisfied.  Tha  ancountar  la  coneldarad  only  until  both  aides  have  detected  tha  other. 

At  that  time,  the  relative  positions  and  headings  ara  stored  for  output  so  that  usari  can  detrtmlna  which 
aid*  has  tha  relative  advantage.  Kills  occur  only  If  weapons  era  fired  before  detection  by  both  aldaj  has 
occurred.  At  the  termination  of  tha  engagement,  both  sides  return  to  tha  nominal  flight  profile  for  the 
return  flight. 

Most  of  the  features  of  tha  air-to-ground  AEP  miaalon  analyala  program  have  bean  retained.  A  miaalon  is 
described  by  tha  vehicle  hardware  makeup,  flight  profila,  end  mission  functions.  However,  thaaa  muat  ba 
described  for  both  Bluo  and  Rad  aircraft.  All  Blu*  aircraft  (and  similarly  all  Rad  aircraft)  muat  ba 
identically  equipped  (Blue  naad  not  b*  tha  asms  as  Rad). 

Th*  output  it  composed  of  statistics  describing  random  variables  and  tha  occurrence  of  discrete  events.  The 
outputs,  available  for  both  sides,  include  target  detection  probabilities,  target*  detected,  targets 
identified,  engagement  date,  aircraft  loaaea,  equipment  failure*,  function/aubfunctlon  utilization,  and 
aircraft  abort*. 

B.  Dogfight  Analysis 

Separata  air-to-air  dogfight  programs  hava  been  incorporated  in  the  AEP  for  analysis  of  th*  dogfight 
encounter.  FA8TAC,  a  one-on-one  model  adapted  by  Battslle  from  the  Rand  TACTICS  II  model,  simulates  an  engage¬ 
ment  between  two  aircraft.  Another  modal,  PACAM,  developed  by  Kearnay  Aaaoclataa,  allow*  for  simulation  of 
ona-on-ona,  two-on-ona,  or  two-on-two  engagements.  Both  program*  produce  datarminiatic  trajectories  of  th* 
dogfight  ancountar  utilizing  specific  rulaa  for  maneuvering.  Tha  programs  ara  useful  for  assessing  relative 
aerodynamic  and  thrust  advantages  snd  for  anslyslng  sir-to-air  weapons  and  firs  control  systems. 

To  set  up  n  problem,  the  user  selects  from  the  available  aircraft,  daflnas  the  initial  conditions,  and  in  tha 

case  of  PACAM,  defines  tactical  rulaa  for  the  aircraft.  Tha  FASTAC  rulaa  of  encounter  ar*  fixed  and  ar* 

baaed  mainly  on  an  attempt  to  maximize  aircraft  energy  (speed  or  altitude)  and  tchiava  a  closing  position  on 

the  rear  of  the  other  aircraft.  In  tha  case  of  PACAM,  the  uaar  can  aalact  tha  typa  of  tactics  to  ba  used 

when  two-on-one  or  two-on-two  engagement*  are  simulated. 

A  comprehensive  on-line  plot  capability  has  bean  developad  to  support  uaa  of  ths  dogfight  analysis  programs. 
Users  can  plot  numerous  position,  velocity  end  acceleration  componant.s  in  2  or  3  dimansiona.  Thts*  plot* 
can  be  generated  in  either  a  fixed  nference  or  any  of  the  moving  aircraft  coordinate  systems.  Thus,  users 
can  execute  one  of  the  dogfight  models  and  than  view  the  resultant  trajectories  from  any  angular  position 
relative  to  the  engagement  coordinate  system. 

A  asperate  program  exists  for  analysis  of  the  trajectories  produced  by  th*  dogfight  programs.  Tha  user  can 
daflna  firing  criteria  in  terma  of  the  minimum,  maximum,  and  time  duration  for  parameter*  like  range. 


31-4 


angle-off,  range  rate,  etc.,  which  must  be  satisfied  for  successful  firing  to  occur.  Then,  the  analysis 
program  will  examine  the  trajectories  to  define  Intervals  in  which  the  criteria  are  satisfied. 

9.  Interactive  Graphics 

The  AEP  programs  have  been  incorporated  In  interactive  graphics  software  packages  to  provide  the  user  with 
an  easier  means  of •  communicating  with  the  computer.  Data  are  entered  with  simple  formats  using  sasily 
understood  acronyms  for  commands.  Whan  s  data  sat  haa  bean  praparad  for  execution  of  one  of  the  AEP  models, 
the  processor  examinas  the  date  for  consistency,  thus  allmlnatlng  most  of  the  typical  keyboard  entry 
mis takes. 

Extensive  data  storage  is  available  as  part  of  tha  interactive  processor.  Thus,  data  that  are  entered  for 
execution  of  one  of  tha  models  can  be  stored  for  later  modification  and/or  ra-axacution.  Where  input  data 
are  extensive,  it  is  logically  subdivided  and  stored  aa  aubaata.  Thus,  for  axamplt,  users  can  aaparataly 
stors  hardware  reliability  data,  function  performance  data,  aerodynamic  data,  and  flight  profiles  for  uaa 
in  tha  air-to-air  or  air-to-ground  mission  analysis  programs, 

A  vary  important  "help"  file  and  a  complete  on-lina  uaer'a  manual  era  available  to  aid  tha  user  in  communi¬ 
cating  with  tha  processor  and  associated  programs.  On-lina  help  la  requested  by  entering  e  question  mark 
in  any  portion  of  the  interactive  processor.  Available  commands  era  Hated  and  can  then  be  described  in 
mora  detail  If  deaired.  Formate  for  entering  commands  are  provided  along  with  typical  examples. 

Tha  incorporation  of  intaractiva  graphics  was  an  important  milestone  in  tha  application  of  tha  AEP. 
Mathematical  modeling  of  air  weapon  syatims/aubaystama  is  a  vary  common  activity.  However,  development  of 
a  library  of  datuilad  evlonice  assessment  models  directly  available  (vis  tslephono  line)  to  design  engineers, 
operations  research  analysts,  managers,  and  SPO  personnel  scattered  throughout  the  DOD  end  industry  is  e 
unique  effort.  In  addition,  the  use  of  interactive  graphics  allows  rapid  response  anawara  to  analytic 
questions  that  arise.  Once  an  aircraft  has  been  Initially  examined  In  a  given  scenario  (and  tha  aaaoclatad 
input  data  convanlantly  utorad),  "what  if"  quaationa  can  be  answered  in  a  matter  of  hours  rather  then  the 
typical  days,  weeks,  or  months.  Thus,  the  modsli  can  become  a  ustful  tool  of  the  planner /manager,  providing 
timely  Input  to  the  decision-making  process. 

10.  Conclusion 

The  AEP  provides  the  Air  Force  end  the  DoD  with  a  collection  of  well-documantad,  well-undaretood  computerised 
models  for  performing  detailed  trede-off  analyses  of  air  weapon  system  configurations.  The  availability  of 
these  programs  to  contractors  as  Government  Furnished  Equipment  in  support  of  specific  DoD  efforts, 
significantly  raducaa  expenditures  for  contractor  and  hanca,  for  tha  DoD,  In  concluaion,  theta  programe 
providt  tha  Air  Korea  Avionlca  Laboratory  with  an  efficient  tool  for  conducting  in-houia  analyses  of  current 
and  postulated  avionic  syatsms  in  a  wide  spectrum  of  operational  environment*. 


SIMULATION  FOR  WHOLE  LIFE  DEVELOPMENT 


R.J.  MORROW  and  R.  RICHARDS 
BRITISH  AEROSPACE,  DYNAMICS  GROUP 
GPO  BOX  No  77,  BRISTOL  B899  7AR.  U.K. 

SUMMARY 

Thii  papa r  la  dsvotsd  to  a  daacriptlon  of  a  aptolal  purpose,  raal-tin*  altnilator  aultabla  for  whole 
Ufa  davalopmant  of  comp  lax  avlonlci  control  systems,  Software  flexibility,  a  currant  aquipmant 
•ailing  point,  dagianda  a  ra-appraiaal  of  pravioua  equipment  davalopmant  procedural,  No  longer  may  a 
control  proeaaaor  ba  assumed  to  have  bean  fully  developed  whan  installed.  Rather  an  on-going  whole 
Ufa  davalopmant  programme  la  naadad.  It  la  In  thia  area  that  new  aimulation  tachniqUaa  can  play  a 
aigniflcant  parti  Future  problema  with  high  apaad  Information  handling  will  occur  during  the  , 

davalopmant  of  new  digital  controllera  whan  uaad  for  oommand  and  control,  ESM  and  EW  ayataaa.  The 
need  la  to  ilmulata  thoaa  rail  world  faotort  that  load  the  information  to  the  digital  procqialng 
ayatam  under  davalopmant.  A  aolutlon  la  propoaad.  The  way  forward  la  to  aimulata  tha  multi-a lament 
real  world  aa  a  eat  of  autonomoua  information  ganarating  aourca*  uting  large  parallel  procaaaing 
arraya.  Tha  demanded  high  Information  ratal  are  achieved  by  multiplexing  tha  output  of  tha  individual 
element#  in  tha  array.  Whan  thii  ii  coupled  with  a  limpllcity  of  ilmulator  control  and  a  mean*  of 
aoftware  aimulation  of  tha  individual  icanario  element*  tha  aolutlon  her  wide  application.  Further 
by  aimulatlng  totally  in  tha  digital  domain,  direct  interface  with  th*  phyeical  procaaaing  aquipmant 
may  ba  raaliaad.  In  thii  mannar  whola  Ufa  davalopmant  may  b*  achieved  with  tha  aimulator  in  ua* 
during  the  faaaibllity  phaat  to  tait  alternative  aoftwara/hardwar*  atratagia*.  Than  during  tha 
davalopmant  phase  to  complainant  practical  trials,  and  finally  in  tha  operational  phaso  to  raviaa  and 
improve  aoftware  according  to  tactical  dictate*, 

1.  INTRODUCTION 

Tha  recant  advance*  in  th*  field  of  micro  electronic!  offer*  a  promise  of  batter  equipment  solution* 
to  a  wide  range  of  military  raquiramanta,  Th*  military  avionica  and  weapon  fialda  ara  typical  in  thii 
raspact.  If  viawad  aa  a  whola  an  aircraft  haa  numerous  raiil-tim*  electronic  procaaiing  raquiramanti 
and  it  i*  aalf  evident  that  military  atandard,  microprocessor  bated  itructurai  will  incraaiingly  taka 
tha  burden  of  growth  in  ayatam  capability,  Thi*  potential  ii  already  having  an  impact  on  th*  daaign 
of  avionica  for  th*  nawait  fighter  aircraft  (Countarmaaaurai ,  1976)  and  in  the  raatarch  programme! 
dealing  with  integrated  avionica  with  high  reliability  (Dryit  J.J,,  Hopkini  A.L.,  1978),  control  and 
diaplay  (Kopchick  A.N.,  Pramaalaar  S.J.  1976)  and  electronic  warfare  (Doyla  W.C,  1979),  Tha  future 
uia  of  computers  will  eventually  radically  changi  ideal  about  th*  daaign,  davalopmant,  manufacture  and 
maintenance  of  raal-tima  control  ayctama,  Th*  ourrant  levels  of  raiaarch  end  development  into  tha 
hardwara  and  softwara  daaign  of  raal-tlm*  control  ayatami  raquira  u  complamantary  intarait  in  teat 
and  davalopmant  aquipmant.  Tha  revolution  of  th*  microcomputer  ha*  baan  complamantad  by  th*  supporting 
microcomputer  davalopmant  aid*  (Lin  W.C.  1977).  It  ia  therefore  judged  important  to  develop  incraaa- 
ingly  aophiatiaatad  system  laval  tait  and  davalopmant  aquipmant. 

Further, to  raaliaa  tha  important  benefit!  of  thii  naw  technology)  that  of  radatign  by  aoftwara  update, 
the  ayitem  level  tasting  must  b*  thought  of  a*  a  whol*  life  function.  With  thtss  concept*  in  mind  the 
daaign  of  a  general  lystam  laval,  teat  equipment  haa  been  researched  and  aquipmant  developed  to 
damonitrata  tha  idea. 

2.  WHOLE  LIFE  DEVELOPMENT 

To  place  in  context  th*  need  for  new  approach**  to  lyitem  level  teat  and  davalopmant  facilities,  the 
theme  of  Whole  Life  Development  as  th*  basil  for  tha  procuramant  of  future  control  lyatsma  uitng 
centralized  or  distributed  control  computers  hai  baan  choien.  Th*  hardwara  economics  of  microprocessor 
alectronica  ball*  th*  true  cost  incurred  through  tha  design,  davalopmant  and  test  support  naadad  to 
produce  th*  software  product.  Th*  traditional  approach  has  used  monolithic  centralised  control 
structures,  general  purpose  military  standard  computer*  and  standard  real-tim#  language*  in  an  attempt 
to  raduc*  tha  suftvar*  davalopmant  and  oaintanenca  overheads,  Alternative  daaign  atrataglsi  tr* 
currently  emerging  where  tha  problem  la  mapped  to. an  optimum  joint  daaign  of  the  machine  structure 
and  the  supporting  software  architecture.  Th*  driving  fores  for  alternative  design*  ia  for  raduebd 
complexity  of  the  aoftware  task  and  in  turn  a  reduction  in  th*  problem  in  validation  and  in^aarvic* 
maintenance  costs  (Gordon  D.,  Spancar  R.D.,  1977).  Unfortunately,  tha  underlying  objective  of  ix>it 
military  aquipmant  raquiramanti  is  tha  transfer  of  complexity  to  th*  machine.  Thu*  it  is  anticipated 
that  th*  problem  of  ayatam  validation  is  going  to  Increase  aa  v*  strive  to  mast  thas*  raquiramanta. 

For  thia  reason  it  was  thought  worth  while  investigating  th*  problem  of  system  teat  in  detail,  taking 
into  account  th*  recant  advances  in  computer  technology. 

Tha  axtanaiva  uia  of  general  purpose  computers  is  an  accaptad  appraoch  to  tha  davalopmant  of  raal-tima 
control  aystama.  In  tha  fallibility  and  project  definition  stages  ganaral  purpose  computer*  ar*  uaad 
to  program  and  run  system  models  of  competing  solutions  leading  to  th*  definition  of  th*  control 
algorithms.  Following  this,  during  tha  dsvalopmsnt  phaaa,  ganaral  purpose  conputars  ara  again  usad 
to  produce  correct  aoftwara  and,  during  tha  course  of  ayitem  test,  to  simulate  operational  inputs  to 
tha  control  proeaaaor.  Finally,  during  tha  in-aervica  life  of  th*  equipment  ganaral  purpose  computers 
may  b*  usad  for  software  maintenance  and  program  update  and  tait.  In  th*  general  course  of  evsnt* 
this  ad  hoc  usa  of  computer  facilities  is  net  necessarily  tha  most  economic  approach.  For  this  reason 
it  is  suggested  that  the  use  of  *  specially  designed,  ayatam  level,  davalopmant  facility  can  offer 
significant  advantages. 


In  term*  of  a  real-time  control  processor  development  programs  thie  facility  would  need  to  have 
the  following  featured 

*  Software  simulation  of  the  total  problem. 

*  Real-time  tret  data  generation  mode. 

A  Direct  hardware  interface  to  prototype  control  processor. 

*  Simple  to  u^e  operator  interface  for  tasting. 

Thasa  faaturai  allqv  tha  facility  to  ba  usad  at  all  stages,  including  in-service  software  update, 
this  feature  representing  a  dominant  programme  requirement  for  certain  military  systems  (Rutland 
R.N.,  Maher  R.A.) ,  The  economics  of  this  approach  have  to  be  derived  for  each  particular  project. 
These  are  presently  bated  on  the  cost  of  using  general  purpose  computer  facilities  during  development 
and  later  when  in-service,  as  opposed  to  the  cost  of  procuring  a  single  speciel-to-typs  facility  on 
which  all  the  software  can  ba  developed.  This  latter  approach  benefits  from  not  being  subject  to 
inflation  and  immune  to  cost  escalation  resulting  from  procuring  additional  computer  capacity  to  meet 
unforeseen  prohlems. 

SIMULATION  AND  SIMULATOR  STRUCTURES 


In  practice  real-time  control  processors  are  usad  for  many  applications t  missila  control  syattma, 

ESM  systama,  ECM  control  syitama,  display  systsms  stc.  For  this  rssson  a  general  control  problara 
has  bean  selected  to  illustrata  tha  chosan  simulator  solution.  It  is  laft  to  tha  raadsr  to  infer  tha 
ralavance  of  the  eolution  to  particular  control  syatam  applications. 

Tha  gantraliaed  control  syatam  problam  is  shown  in  Figura  1.  Tha  processor  his  a  raal-tima  control 
strategy  based  on  tha  use  of  sensed  analogue  information  which  is  provided  by  one  or  more  sensoru . 

This  information  is  digitlasd  and  fed  to  a  central  pvoceasor  structure.  Tha  control  processor 
responds  to  tha  sanssd  date  to  alter  the  platform  flight  profile  And  elements  of  the  reel  world 
referenced  to  tha  eeneors.  Certain  major  parematera  era  displayed  and  updated  for  uae  by  a  human 
operator. 

The  simulation  requirements  are  two  fold  i  a  system  model  and  a  date  generation  test  model.  The 
former  is  characterised  by  the  relaxation  of  tha  requirement  for  reel  time  plus  ths  feet  that  the 
control  processor's  operation  may  ba  incorporated  as  a  system  model.  In  the  caee  of  the  test  model 
the  simulator  must  adequately  represent  all  those  elements  except  the  control  procteeor  such  that 
the  input  and  output  date  streams  are  repraientative  of  operational  condition.  Further,  in  order 
to  have  the  neoesiary  dogree  of  flexibility,  ell  major  parameters  must  be  accaasabla  to  the  simulator 
user  with  a  simplicity  of  human  interface  Co  allow  change  and  recording  of  teit  conditions. 

Hie  design  of  a  simulator  that  meets  thasa  requirementN  hae  to  be  approachod  with  soma  caution. 

Although  flexibility  is  nacasaary  -  thus  tha  choice  of  e  computer  based  structure  -  complex  software 
end  high  development  coats  are  not.  Additionally,  as  a  teat  instrument  its  standard  of  reliability 
and  error  diagnostics  must  be  high  so  as  not  to  jeopardise  any  development  programme.  In  general 
the  standard  fur  choosing  the  simulator  design  should  ba  a*  high,  if  not  higher,  than  that  for  tha 
control  processor  structure.  One  exception  is  ths  build  standard  whara  thars  ia  tha  freedom  to  use 
commercial  alactronic  products  with  their  coat  advantages. 

The  simpleet  simulator  configuration  is  a  standard  general  purpose  computer  and  high  level  language. 

In  general  the  system  model  may  be  realised  without  difficulty,  but  s  direct  application  to  testing 
is  limited  by  the  computer's  maximum  instruction  rate  and  I/O  facilities.  In  terms  of  commercially 
available  computers,  a  need  for  realism  of  simulation  with  correct  I/O  rates  inevitably  laada  to 
main  frame  operating  performance  being  required.  This  occurs  in  many  cases  because  tha  distributed 
characteristics  of  the  real  world  do  not  map  directly  to  sequentially  operating  computers.  Modular 
distributed  computer  structures  offer  significant  advantages  in  this  respect.  Returning  to  the 
problem  illuetretion,  Figure  1,  parallel  information  may  be  said  to  exist  at  the  environment  to 
eeneor(e)  and  senior(e)  to  control  processor  intarfscas.  Thasa  areas  ars  candidates  for  distributed 
computer  simulation.  In  ganeral  if  tha  global  problem  can  bt  specified  as  a  eat  of  N  alemsntal  data 
generators  with  defined  input  and  output,  than  a  set  of  N  independent  processors  may  be  usad,  Figure  2, 
This  approach  leads  to  a  restatement  of  tha  problam  Illustration,  as  shown  in  Flguru  3.  With  this 
form  of  distributed  intslligsncs  system,  tasks  assigned  to  elements  in  ths  multiple  computer  config¬ 
uration  remain  fixed.  Whan  programmed,  elements  in  ths  structure  act  as  digital  transfer  functions 
passing  transformed  input  data  to  a  subsequent  stage  of  simulation,  i.e.  platform  motion  -  environment- 
sensor(s)  -  control  processor.  Platform  motion  is  thus  defined  as  the  forcing  function  for  the  first 
array.  This  data  is  required  by  ell  units  end  thus  leads  to  the  definition  of  a  master-sieves 
organisation  with  Interconnection  via  a  bidirectional  highway.  Such  a  configuration  permits  the 
following  functions  to  ba  performed. 

*  Simulation  program  loading. 

*  Periodic  flight  profile  update. 

*  Monitor  of  states  of  individual  simulation  units, 

The  next  stage  of  inti rcounection  is  from  the  first  array  to  the  second.  This  simulates  ths  sensors 
interrogating  the  environment.  This  is  incorporated  using  e  unidirectional  highvay  under  tho  control 
of  the  ccnqnjters  representing  seniors.  The  i ime  conditioni  apply  to  the  aenior(i)  to  control  processor 
link. 

The  potential  benefit  of  thie  approach  to  problem  reduction,  where  parallelism  is  stressed,  is  gained 
through  the  low  cost,  elee  and  power  consumption  of  microprocessor  based  microcomputer*.  It  has  bean 
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recognised  that  it  nay  ba  more  economical  to  uae  many  processors  than  to  upgrade  to  a  faater 
baaic  machine  and  formal  approaohee  to  problem  reduction  are  under  atudy  (Dowsing  and  Daglem, 

1979).  With  this  approach  to  simulator  design  using  a  paralle.  distributed  computer  structure, 
the  problems  of  real  time  simulation  are  overcome  but  not  at  the  expense  of  software  aimulation 
flexibility.  Further  if  a  generalised  modular  microcomputer  design  is  used  the  hardware 
economics  of  the  structure  can  compare  favourably  with  the  cost  of  solutions  based  on  mid  rings 
computers . 

To  investigate  the  operational  performance  of  this  approach  to  a  general  purpose  simulator  and 
to  establish  ths  lsvsl  of  complexity  of  tht  programming  task  a  microcomputer  array  simulator  has 
bean  constructed.  This  is  designed  to  simulated  control  problems  of  the  type  illustrated  in  Figure  1. 

The  hardware  build  programme  has  centred  on  ths  design  and  build  of  an  expandable  microcomputer 
array  and  its  input  and  output  interfaces.  For  the  first  stags  of  simulation  (the  input  to  the 
array),  and  tha  third  staga  of  the  liuuation,  (processing  ths  multiplexed  dsta  output)  commercially 
available  mini  computers  wars  selected.  Ths  overall  feed-back  loop  is  then  closed  via  a  link  between 
these  mini  computers  to  arrive  at  tha  equivalent  of  Figure  1.  This  configuration  allows  investigation 
of  ell  major  hardware  and  software  feeturoe  of  the  approach,  namely i 

*  Array  program  loading 

*  Simulation  house  keeping 

*  Simulation  software  design 

a  Parallel  asynchronoui  operation 
a  Real  time  data  transfer  and  time  ordering 
a  Modular  hardware  design 

4.  A  MICROCOMPUTER  ARRAY  SIMULATOR 

One  of  tha  main  criteria  in  tha  design  of  the  simulator  wae  that  system  elements  should  ba  independent 
i.e,  modification  of  any  one  clement  should  not  necessarily  result  in  the  modification  of  any  other 
system  element.  The  baseline  system  requirement!  were  i 

a  real  time  simulation 

a  autonomous  simulating  elements 

a  modular  construction,  hardware  and  software 

a  overall  system  operating  speed  not  to  be 

governed  by  slowest  element 

*  communication  between  elements 

*  one  clement  should  have  executive  control 

An  Investigation  wua  undertaken  into  the  size  of  array  that  would  be  required  to  simulate  the  typical 
environment.  It  became,  meanwhile,  apparent  that  the  clement  acting  as  executive  would  be  required 
to  he  significantly  more  powerful  than  other  elements  in  the  array.  The  conclusions  were  that  the 
system  should  include  up  to  256  simulating  elements  (microcomputer)  linked  to  a  single  dedicated 
executive  (mini  computer)  and  u  system  output  cspability  of  up  to  one  million  words  par  second,  Figure  4. 

Executive  Control 

The  function  of  the  Executive  is  to  provide  an  interfaoo  for  the  human  operator  and  also  to  provide 
system  housekeeping.  A  standard  minicomputer  (PDP11)  plus  peripherals  was  chosen  for  this  purpose, 

Fig.  5.  The  choice  of  such  a  minicomputer  system  permits  its  use  for  microcomputer  progrsra  development. 
In  this  mode  the  minicomputer  is  supported  by  the  RT-11  operating  system  and  a  cross  assembler  written 
specifically  for  the  purpose.  Thu  RK05  high  speed  disc  system  is  used  for  program  development! 

(replacing  an  original  much  slower  paper-tape  system)  and  storage  of  software  models.  A  librir'y  of 
models  is  stored  on  disc  permitting  loading  into  the  respective  microcomputer  memory  as  demanded  by 
the  operator,  vis  the  input  bus.  Display  information  is  output  to  a  colour  V  D  U  using  s  V  T  30 
interface  card,  Keyboard  and  printer  are  standard  peripherals.  The  input  bus  is  designed  to  permit 
system  flexibility.  Data  transfer  is  asynchronous,  the  handshake  is  software  controlled,  no  ipecial 
purpose  hardware  controller  is  required  at  thu  Executive  to  undertake  the  bidirectional  dsta  transfer. 

Simulating  Elements 

The  Simulating  Element  has  been  designed  as  a  general  purpose  microcomputer  having  ths  minimum  of 
hardware  Interface  constraints.  Two  I/O  ports  are  provided,  each  permitting  parallel  word  data 
transfer  to  maximise  operating  speed. 

The  microcomputers  are  designed  around  the  Intereil  6100  microprocessor.  (Thomas  A.T.  1976),  This  is 
a  1?  bit  processor  in  CMOS  which  recognizes  the  instruction  set  of  the  PDP8/E  minicomputer.  A  block 
diagram  of  the  microcomputer  is  shown  in  Fig. 6.  Of  the  4K  memory  directly  addressable  by  the  5100, 

236  words  are  in  PROM  (containing  the  loader)  and  the  remainder  in  RAM.  In  fact  4K  of  RAM  is  fitted 
but  the  top  256  words  are  not  used.  Each  microcomputer  is  built  on  an  extended  double  Eurocard  and 
the  design  mid  manufacture  has  been  completed  by  BAe .  All  the  Simulating  Elements  (microcomputers) 
are  identical  including  the  PROM  software  (but  excluding  RAM  software).  The  gain  identity  from  their 
physical  location  within  the  system  i.e.  each  hoard  location  is  uniquely  addressable.  The  design 
permits  up  to  256  autonomous  Simulating  Elements,  The  Input  Bus  data  I/O  is  controlled  by  n 
Peripheral  Interface  Element  (PIE) ,  6  Control  linee  are  ueed  for  device  selection  and  data  flow 
direction,  A  second  I/O  port  is  provided,  and,  although  configured  us  a  completely  general  purpose 
port,  its  use  in  the  prosunt  system  is  limited  to  data  destined  for  the  syatum  output  bus, 
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Input  Bu« 

The  Input  Bu*  Interface  Board  provide*  all  the  buffering  end  but  separation  circuitry  required  for 
interfacing  the  microcomputer*  with  the  DR11C  output  from  the  PDP11.  It  i*  d**igned  to  interface 
up  to  16  cards  (on*  card  frame)  and  buffer  thoa*  *ignal*  required  by  the  following  card  frame.  It 
also  provide*  the  latching  and  decoding  required  for  board  addre**ing.  A  schematic  diagram  of  the 
Interface  Board  is  «hovn  in  Pig.  7.  It  ia  housed  on  a  tingle  p.c.b.  of  the  aame  alia  a*  a  micro¬ 
computer  board.  The  bidirectional  input  but  compri»ee  12  data  llnee  and  6  control  line*.  Bua  data 
direction  la  controlled  by  tha  PDP-11,  and  data  transfer  it  on  a  word  by  word  baaia  under  control 
of  three  handahake  (H/S)  line*.  Data  may  be  tranafarred  in  one  of  four  raodeai- 

From  Executive-Unique  i  data  word  it  loaded  to  uniquely  addresaad  microcomputer. 

From  Executive-Global  t  data  word  i*  loaded  simultaneously  to  all  microeonputare . 

To  Executive  Unique  t  Executive  requasts/accepta  data  from  specific  microcomputer. 

To  Executive  Global  l  a  number  of  microcomputers  have  data  for  Executive  which  inatigates 

a  non-ambiguoua  sequential  selection  process  to  accept  this  data. 

A  transfer  of  data  between  the  Executive  and  microcomputer  can  consist  of  any  number  of  words  as 
determined  by  tha  software.  The  interface  ia  designed  for  12  bit  data  word*,  but  the  use  of  a  general 
purpose  (DR11-C)  I/O  to  the  Executive  (PDP-11)  enables  the  aystem  to  ba  relatively  easily  modified 
to  cope  with  16  bit  data. 

Real  Time  Data  Output 

The  system  is  designed  to  output  real  time  data,  with  a  timing  resolution  of  l  uS.  Each  microcomputer 
is  accessed  for  data  on  a  sequential  basis.  A  data  block  is  output  at  each  interrogation,  thin  block 
represents  data  that  is  to  occur  during  a  subsequent  defined  time  frame,  Currently  this  time  frame 
it  lmS,  By  outputting  data  in  blocks  the  ratio  of  the  peak  to  main  data  rata  on  the  output  bua  ia 
low.  The  output  bua  is  16  bits  wide  to  cope  with  future  system  updating.  Every  microcomputer  is 
interrupted  each  lmS  Fig.  8,  it  must  than  generate  tha  data  descriptions  for  that  time  frame,  time 
tagging  them  to  1  uS  resolution.  This  data  ia  then  read  into  on*  half  of  a  double  buffer  store,  Fig. 9. 
Whilst  this  data  generation  la  performed  the  other  half  of  the  double  buffer  store  (containing  tha  date 
from  tha  previous  1  mS)  is  available  for  writing  to  the  output  bua  when  accessed.  Since  all  micro¬ 
computer*  may  generate  data  autonomously  and  era  accrued  sequentially,  the  data  appearing  on  the  bua 
it  not  necessarily  in  correct  time  sequence.  To  correct  this,  tha  data  ia  road  into  the  Sorting, Buffer 
Where  it  is  time  ordered  (using  the  luS  time  tags)  and  output  in  a  perfectly  ordered  time  aequence. 

The  Sorting  Buffer  is  also  designed  to  handle  time  overlapping  date.  Tha  ayitem  timing  anaurat  that 
all  microcomputer  output  data  timing  ia  synchronised.  Since  there  ia  a  limiting  value  to  tha  data 
rate  that  any  microcomputer  can  achieve,  thia  synchronisation  la  used  to  Interleave  data  streams  from 
mor*  than  one  microcomputer  to  produce  a  higher,  composite,  data  rata  from  any  one  element.  The 
aystem  permits  mora  than  one  Sorting  Buffer  to  ba  linked  to  the  Output  But,  providing  simultaneous 
rsal  time  output*  to  one  or  mora  Device*  Under  Test  (DUT) .  Special  purpose  interfaces  are  required 
for  different  DUTS. 

The  DUT  it  stimulstsd  by  tha  input  data  end  its  output,  if  required,  may  bn  connected  back  to  tha  Input 
Bua,  Fig.  4.  and  aubaequantly  to  the  microcoraputera  to  produce  a  totally  interactive  system. 

Packaging 

A  modular  packaging  syatam  ia  uaad,  based  on  the  Euroeard  ayatam.  Standard  card  frames  house  extended 
double  Euroeard  site  peba.  Each  card  frame  contain*  card  mountad  power  auppliai.  Thia  form  of  packag¬ 
ing  allows  for  ease  of  maintananc*  (by  replacement  on  aite  and  repair  back  at  bass)  and  flexibility  in 
expanaion  and  development. 

5.  OPERATING  PRINCIPLES 


The  choice  of  high  or  low  level  language  depends  on  whether  any  specific  program  is  to  ba  run  on  ths 
minicomputer  or  microcomputer (a) .  With  lest  than  4K  of  memory  available  in  each  microcomputer,  coda 
compactness  is  important.  ThiB  factor,  plus  the  requirement  that  programs  ars  to  bs  exscutsd  in  rsal 
tims,  dictates  the  choico  of  a  low  level  language  for  the  microcomputer  software.  Whilst  the  use  of 
a  high  leael  language  might  ease  the  problem  of  finding  suitable  programmers  to  writs  tha  aoftware, 
thia  advantage  ia  mora  than  offaat  by  the  (unrealistic)  requirement  to  have  an  intimate  knowledge  of 
the  appropriate  compilei(s)  to  predict  storage  and  timing. 

Thoa*  requirements  do  nut  normally  exist  whan  writing  aoftware  for  the  minicomputer.  The  progrem 
currently  being  executed  ia  held  in  coru,  with  access  if  required  to  data  held  on  disc.  i.e.  storegsi 
efficiency  is  not  critical. 

Efficient  Program  Execution 

✓ 

The  generation  of  real  time  data  from  the  microcomputer  array  to  represent  the  physical  environment 
ei  observed  by  the  sensors  can  result  in  programs  that  contain  complicated  mathematical  routinas.  The 
execution  time  of  such  programs  can  be  comparatively  long  reoulting  in  low  maximum  simulated  data  rates. 
This  ia  a  function  of  the  microprocessor  chossn,  the  next  generation  of  16  bit  machine*  offsr  only  a 
partial  solution.  An  alternative  technique  that  has  been  employed  1b  to  use  a  table  of  valuaa  to 
represent  the  function.  This  approach  allow*  the  mathematical  routine  to  be  efficiently  evaluated  > 

using  a  high  level  language  on  the  minicomputer,  and  a  Table  constructed.  The  teble(s)  then  form*  pert 
of  the  microcomputer  program.  With  thia  approach  the  maximum  data  rate  may  be  increased  as  a  trad*  off  • 
against  simulation  accuracy  and  microcomputer  memory  size.  Certain  of  the  important  concepta  may  bs 
illustrsted  using  an  airborne  ESM  problem.  The  solution  involve*  representing  each  of  the  dietributed 
emitter*  as  individual  contributors  to  the  multiplexed  data  input  to  the  ESM  Control  processor.  This 
is  achieved  ueing  individual  microcomputers  to  reprssant  individual  emitters,  The  time  multiplexed 


data  at  the  output  of  tha  microcomputer  array  i«  thua  equivalent  to  that  input  to  the  control 
procaator,  and  can  be  ueed  for  development  or  teit  purpoaee.  Individual  amittari  are  defined 
uaing  their  main  parameter!,  e.g.  amplitude,  frequency,  pulae  width,  pulae  repetition  interval, 
and  are  implemented  a»  word  generator*,  with  each  word  containing  the  current  value  of  these 
parametere.  The  variation  in  time  of  the  perimeter  value  it  a  characteristic  of  both  the  design 
of  the  emitter  and  its  poaitionel  relationship  to  the  airborne  platform.  The  deiign  of  the  emitter 
ia  incorporated  into  the  software  emitter  model.  For  example  a  radar's  scan  pattern  can  be  defined 
mathematically  end  hence  tha  pules  amplitude  envelope  for  a  pulse  radar,  a*  teen  at  any  point  in 
apace,  may  b*  calculated  using  a  high  ltva.l  language  routine  on  tha  minicomputer.  This  may  bt 
storad  at  a  look-up  table  for  loading  with  the  emitter  simulation  program.  As  all  emitters  are 
related  to  the  airborne  platform's  poaition  it  ia  conveniant  to  give  periodic  positional  updates 
from  the  minicomputer  to  all  aicrocomputara .  In  this  manner  the  platform's  poaition  relative 
to  the  radar's  pointing  direction  may  be  calculated  uaing  the  microcomputer  program,  end  the 
appropriate  amplitude  value  (elected  from  the  prc-computed  table.  This  amplitude  value  may  be 
modified  according  to  the  range  to  give  a  correct  interpretation  of  the  change  in  received  signal 
strength.  Similarly  values  of  frequency  end  pulse  width  may  be  eelected  from  look-up  tables.  Tha 
value  for  the  pulse  repetition  interval  Is  directly  related  to  the  time  of  occurrence  of  the  data 
as  received  by  the  control  processor  under  teat.  This  is  achieved  by  time  stamping  the  data  at 
aourca  (microprocessor)  and  than,  at  tha  output  of  tha  multiplexed  highway,  ordering  the  data  in 
the  correct  time  sequence. 

With  this  simulation  all  major  paramatan  art  software  flexible  end  the  whole  acts  ae  both  a  system 
level  model  and  a  real  time  teat  generator.  Tha  control  processor  strategy  may  be  introduced  through 
tha  uie  of  e  second  mini-computor  coupled  to  the  output  of  the  microcomputer  array.  Alternatively 
tha  control  procateor  itself  may  be  included  in  the  loop.  The  use  of  a  minicomputer  ae  ths  executive 
control  interface  allows  provision  of  standard  peripherals  to  simplify  tho  human  interface,  Typically, 
visual  display  hard  copy  and  magnetic  disc  storage  allow  a  high  level  operator  interface  to  be  cons¬ 
tructed  providing  in  the  case  of  this  problem,  options  for  i 

*  emitter  selection  and  daployment 

*  flight  profile  compilation 

*  real  time  display  of  major  interaction* 

*  hard  copy  listings  of  both  input  set  up  data  and  run  data 

*  rapcat  of  teat  conditions 

CONCLUSION 


A  versatile  digital  simulator  has  been  constructed.  This  simulator  takes  full  advantage  of  the  low  coat 
of  microprocaaeor  electronic*  with  a  deiign  baaed  on  the  uae  of  a  large  microcomputer  array.  Thie 
approach  aimplifiaa  tha  problem  of  implementing  a  software  flexible,  real  time  test  dsta  simulator  end 
offers  tha  betid  for  a  unified  approach  to  ayatam  modelling,  The  rtsulti  indicate  that  this  approach 
to  computer  simulation  for  system  design,  test  and  software  maintananoa  may  offer  an  economic  alter¬ 
native  for  certain  projects  wharu  real-time  process  control  is  to  be  implemented  using  software  ae  tha 
major  element  of  in  service  flexibility.  Software  development  and  testing  requires  sn  investment  in 
system  level  took*  to  take  full  advantage  of  the  benefits  offered  by  currant  end  future  processor 
electronics.  This  simulator  in  an  example  of  the  possible  uae  of  the  same  electronics  but  applied  to 
the  construction  of  a  test  equipment. 
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Fig, 2  Problem  reduction 
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Fig. 3  Reconfigured  problem 
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A  SIMULATION  SUPPORT  SYSTEM 
THE  DEVELOPMENT  TOOL  FOR  AVIONIC 
SYSTEMS  AND  SUBSYSTEMS 

John  C.  Ostgaard 
Air  Force  Avionics  Laboratory 
Wrlght-Pattarson  Air  Force  Base,  Ohio 

SUMMARY 

As  Avionic  systems  have  grown  both  In  cost,  and  complexity,  more  emphasis  has  been  placed  on  simulation  sup¬ 
port  systems  capable  of  validating  and  verifying  such  systems  prior  to  actual  Implementation.  This  paper 
encompasses  the  simulation  support  facility  required  for  the  development  and  validation  of  the  Digital 
Avionics  Information  System  (DAIS)  program  currently  being  conducted  at  the  Air  Force  Avionics  Laboratory, 
Wrlght-Patterson  Air  Force  Base. 

The  simulation  support  system  Is  composed  of  three  main  elements  -  simulation  support  hardware,  simulation 
support  software,  and  a  host  simulation  computing  complex.  The  Support  Hardware  System  Includes  those 
Interfaces  required  for  the  generation  of  a  data  signal  environment  between  the  simulation  and  the  DAIS 
avionic  suits.  The  Simulation  Support  Software  Is  comprised  of  software  necessary  for  the  simulation  of 
flight  data,  as  well  as  those  programs  which  monitor,  record  and  control  the  data  from  both  the  simulation 
and  the  actual  flight  hardwire.  The  Host  Simulation  Computing  Complax  ganaratas  the  simulation  machenlsms 
necessary  for  the  real-time  emulation  of  airborne  systems.  The  coordination  of  these  three  elements  pro¬ 
vide  e  flexible  support  system  capable  of  control,  simulation,  monitor,  record  and  anelysla  function!. 

1.  INTRODUCTION 

In  the  past,  development  or  augmentation  of  avionics  systems  have  required  extensive  Investment  In  special 
purpose  hardware  and  software  necessary  for  the  simulation  support  of  these  avionics  systems.  The  simula¬ 
tion  systems  have  been  point-designed  to  the  actual  avionics  system  requirements  end  have  not  Included  the 
generic  capability  required  for  a  flexible  and  easily  reconflgurebla  Simulation  Support  System. 

The  development  of  the  Digital  Avionics  Information  System  (DAIS),  which  Is  a  program  currently  being  con¬ 
ducted  at  the  Air  Force  Avionics  Laboratory,  Wrlght-Patterson  Air  Force  Base,  required  a  flexible  simula¬ 
tion  support  facility  capable  of  simulation,  control,  monitor  and  record  functions.  These  capabilities 
have  been  used  to  verify  and  validate  the  system  architecture,  In  both  real-time  and  non  real-time  modes  of 
operation.  «  The  basic  design  of  the  support  facility  was  based  upon  the  requirements  of  the  DAIS  program; 
the  system,  however,  Is  not  limited  to  that  specific  architecture  and  has  many  features  Included  within  It 
to  give  It  widespread  usage.  To  allow  for  a  batter  understanding  of  the  Simulation  Support  System,  a  brief 
explanation  of  the  DAIS  architecture  Is  Included, 

The  Digital  Avionic  Information  System  Is  a  system  architecture  which  can  bo  configured  for  various  avionic 
applications  and  missions,  using  core  elements  or  building  blocks,  The  purpose  of  the  DAIS  concept  Is  to 
reduce  the  proliferation  and  non-standardlaation  of  aircraft  avionics,  and  permit  the  Air  Force  to  assume 
the  Initiative  In  the  specification  of  standard  avionic  systems  and  Interfaces  *or  future  Air  Force  System 
acquisitions. 

Historically,  avionic  systems  have  been  established  along  semi-autonomous  functional  areas  such  as  naviga¬ 
tion,  weapon  delivery,  flight  control,  communications,  etc.  Each  of  these  functional  areas  would  have  a 
digital  system  with  Its  own  processing,  Information  transfer,  control  Inputs,  and  display  set.  There  has 
been  an  interface  between  each  functional  area  only  as  necessary  for  Interaction  purposes,  using  non-standard 
Interfaces,  The  DAIS  concept  proposes  that  the  processing,  Information  transfer,  control  and  display 
functions  be  common  and  service  all  the  previously  described  functional  areas  on  an  Integrated  basis. 

The  DAIS  architecture  as  shown  In  Figure  1  consists  of  processors,  which  communicate  with  each  other  and 
with  the  sensors,  weapons,  controls,  and  displays  through  a  dual  redundant  (H1L-STD-1 553)  multiplex  data 
bus  system  under  control  of  mission  software.  The  mission  software  Is  comprised  of  application  software, 
which  performs  the  processing  required  for  a  specific  aircraft  mission  application,  and  the  executive 
software,  which  performs  the  system  control  and  provides  services  to  the  application  software. 

2.  REQUIREMENTS 

The  design  of  an  Integrated  Simulation  Support  System  must  allow  for  six  fundamental  areas  of  flexibility. 
These  areas  are  depicted  In  Figure  2  and  briefly  described  herein: 

(1)  Avionic  System  Support. 

(2)  Prototype  System  Software  Support. 

(3)  Prototype  System  Hardware  Support. 

(A)  Engineering  Studies. 

(5)  Maintenance  Augme  tatlon, 

(6)  Training  Assistance. 


A  simulation  support  facility  must  have  the  flexibility  of  supporting  an  avionic  system  design  throughout 
all  stages  of  development.  These  stages  Include  Initial  design  analysis,  prototype  development  (both 
hardware  and  software),  complete  system  deflnltlon/lmplementatlon,  and  verification  and  validation.  Within 
this  entire  development,  Integration  procedures,  system  testing  procedures  and  maintenance  procedures 
should  be  defined  and  established.  A  system  designed  using  such  a  facility  should  be  capable  of  providing 
the  necessary  documentation  and  data  to  allow  for  completa  system  Integration  within  an  aircraft  with  minimi! 
risk.  Furthermore,  problems  encountered  during  flight  testing  should  be  reproducible  within  the  simulation 
support  system. 

3.  GENERAL  DESCRIPTION 

The  simulation  support  systam  provides  a  real-time  simulation  of  a  military  aircraft  performing  an  opera¬ 
tional  mission.  Tht  simulation  generates  the  Interface  ilgnals  between  the  simulated  aircraft  stntor  suits 
and  the  DAIS  system  so  that  the  avionic  equipment  Is  subjected  to  a  data  signal  environment  which  Is  nearly 
Identical  to  actual  flight. 

The  support  system  required  for  DAIS  Is  comprised  of  e  Software  Test  Stand  (STS)  and  an  Integrated  Test 
Bed  (1TB).  Tha  Seftwara  Test  Stand  is  used  primarily  to  verify  the  mission  software  resident  in  the  DAIS 
flight  processors.  The  Integrated  Test  Bed  provides  the  capability  to  evaluate  the  DAIS  core  elements  which 
Include  the  mission  roftware,  the  DAIS  processors,  the  data  transfer  system,  and  the  cockpit  control  and 
displays.  The  Software  Test  Stand  Is  currently  a  subset  of  the  Integrated  Tast  Bed,  10  for  purposes  of 
discussion  the  Software  Test  Stand  will  no  longer  be  Included  when  discussing  the  support  system. 

The  support  system  and  Its  relationship  to  the  DAIS  core  elements  Is  shown  In  Figure  3.  The  support  ayitam 
Is  comprised  of  a  network  of  four  computer  systems,  simulation  Interface  hardware,  and  supporting  software 
which  Interface  to  the  DAIS  avionics  via  tha  MIL-STD-T 563  Multiplex  Data  Bus.  The  Simulation  Support  System 
Is  partitioned  Into  basic  functional  elements  which  are  distributed  among  four  individual  computer  systems. 
These  elements  Include  tha  DEC  system  -  10  Models,  Simulated  Subsystem  Data  Formatter  System  (SSDF),  Per¬ 
formance  Monitor  and  Control  Sytam  (PMC),  and  the  Evans  and  Sutherland  (E&S)  Graphics  Systam.  Thestk 
systems  are  Interfaced  via  a  direct  memory  access  channel  (DMA-10)  which  provides  the  capability  of  shared 
I  memory. 

4.  SIMULATION  SUPPORT  HARDWARE 

Tht  support  hardware  provides  the  Interfaces  between  the  simulation  and  the  DAIS  cora  elements.  These  Inter¬ 
faces  Include:  simulated  multiplex  bus  messages  which  drive  the  mission  software,  performance  monitoring  of 
the  multiplex  bus  traffic  and  Internal  oparation  of  the  DAIS  processor,  as  well  as  control  of  the  mission 
software  resident  in  the  DAIS  processors. 

The  Simulation  Support  Systam  contains  the  following  support  equipment: 

(1)  Universal  Remote  Terminal  (URT). 

(2)  Bus  Monitor  Unit  (BMU). 

(3)  Super  Control  and  Display  Unit  (SCADU).' 

(4)  Additional  interfaces  as  follows: 

(a)  Four-Port  Buffer  Memory. 

(b)  PDP-11  SCADU. 

(c)  RS  232  Processor  Load/Control  Channels. 

(d)  TCC  Stick  and  Keyboard. 

4,1.  Universal  Remote  Terminal 

The  Universal  Remote  Terminal  (URT)  Is  a  programmable  interface  device  designed  to  simulate  the  responses 
of  any  or  all  Remote  Terminals  (RTs)  and  their  associated  subaddresses  on  a  MIL-STD- 1 553  multiplex  bus 
(Mux  Bus).  The  URT  Is  comprised  of  four  sactlons.  The  first  section  Is  the  Bus  Interface  Module  (BIM) 
which  provides  an  Interface  between  the  control  unit  of  the  URT  and  the  mux  bus.  The  second  Is  the  Uni  bus 
Interface  Module  which  provides  the  Interface  between  a  PDP-11  Unibus  and  a  user's  device.  The  third 
section  Is  the  Terminal  Control  Module  (TCM)  which  provides  the  timing  and  control  logic  necessary  to 
Implement  the  URT's  control  procedures.  The  fourth  section  Is  the  Response/Mapping  RAM  Module  (RAM  Module) 
through  which  the  URT's  responses  cen  be  specified.  Commands  on  the  mux  bus  are  received  by  the  BIM  and 
responses  are  Initiated  by  the  TCM.  Data  words  are  received  by  and  transmitted  from  the  URT  across  the 
mux  bus  In  response  to  the  command  received.  This  data  Is  mapped  to  and  from  the  PDP-11  memory  space  as 
determined  by  the  main  RAM  mapping  address.  Special  RAMs  are  also  Implemented  on  the  RAM  Module  to  store 
status,  activity,  message  error,  and  last  command  Information  for  each  RT  (0-31). 

The  URT  Is  set  up  and  controlled  by  the  SSDF  software  resident  In  the  PDP  11/40  by  loading  the  appropriate 
URT  registers  and  RAMs.  In  real-time  operation,  the  URT  performs  the  following  operations:  Transfers  DAIS 
multiplex  data  to/from  the  PDP-11  for  each  message  operation,  responds  to  mode  commands  In  accordance  to 
DAIS  multiplex  protocol,  simulates  subsystems  error  and  activity,  and  responds  with  predefined  errors  on 
the  multiplex  data  bus. 
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4.2,  Bus  Monitor  Unit 

The  Bus  Monitor  Unit  (BMU)  receives,  records  and  breakpoints  on  selected  messages  on  the  DAIS  multiplex 
data  bus.  The  BMU  whan  monitoring  the  data  bus  acts  as  a  passive  device  and  stores  the  received  messages 
In  a  POP  11/40.  The  BMU  has  the  capability  to  provide  selective  monitoring  as  follows: 

(1)  Record  the  bus  traffic  beginning  at  a  specified  breakpoint  and  for  a  specific  number  of 

words. 

(2)  Record  the  bus  traffic  beginning  at  a  specified  breakpoint  and  for  a  specific  length  of 

time. 

(3)  Record  the  bus  traffic  beginning  at  a  specified  breakpoint  and  until  a  second  specified 
breakpoint  Is  encountered. 

(4)  Record  the  bus  traffic  beginning  at  a  specific  breakpoint  and  until  the  end  of  the 

massage. 

(5)  Record  all  bus  traffic,  only  control  words,  or  only  data  words. 

(6)  Transmit  a  message. 

The  BMU  also  has  a  manual  control  function  directly  controlled  from  the  BMU  front  panel.  This  mode  of  4 

operation  stores  the  last  64  designated  words  on  the  bus  which  means  all  words,  only  control  words,  only 
data  words,  or  only  message  gap  times, 

4.3,  Super  Control  and  Olsplay  Unit 

The  Super  Control  and  Display  Unit  (SCADU)  provides  the  system  programmer  with  monitor  and  control  capabili¬ 
ties  of  the  Operational  Flight  Program  in  the  AN/ATK-15  flight  processor.  The  monitor  and  control  functions 
are  performed  In  raal-tlme  by  the  SCADU  hardware  without  the  Insertion  of  special  purposa  software  Into  the 
operational  software.  The  SCADU  Is  organized  Into  a  Processor  Interface  Module,  a  Unibus  Interface  Module, 
a  Data  Buffer,  and  the  Control  Unit.  The  Control  Unit  Is  further  subdivided  Into  the  Main  and  Secondary 
Control  RAMs,  the  Data  Comparator,  Programmed  Input/Output  (PI/O)  Control  logic,  the  Discrete  Control 
Decoder,  the  wrap-around  Self-Test  logic,  and  various  counters  and  registers  for  commend,  status,  time-tagging, 
etc. 

In  conjunction  with  the  PMC  software,  the  SCADU  Is  set  up  to  collect,  store,  and/or  breakpoint  on  the  data 
received  from  the  DAIS  processor.  Once  fully  Initialized  the  SCADU  performs  one  or  more  of  the  following 
monitor  functions: 

(1)  Monitor  all  Instructions  addresses. 

(2)  Monitor  specific  Instruction  (Op-code). 

(3)  Monitor  all  jump  Instructions  which  cause  a  branch. 

(4)  Monitor  all  memory  stores. 

(5)  Monitor  all  memory  accesses. 

(6)  Monitor  all  Interrupt  occurrences. 

(7)  Monitor  ell  DMA  occurrences. 

The  SCADU  may  also  perform  one  or  more  of  the  following  control  actions: 

(1)  Breakpoint  (halt)  upon  occurrence  of  one  of  the  specific  functions  above. 

(2)  Log  the  data  In  SCADU  buffer  (trace)  with  a  time  tag. 

(3)  Compare  the  function  with  user's  specific  value  (fixed  point  or  floating  point  numbers) 
and  breakpoint. 

(4)  Halt  processors  and  BCIUs. 

4.4,  Additional  Equipment 

Other  equipments  used  In  the  Support  System  though  not  major  hardware  developments,  do  allow  for  easier 
communication  and  data  updates  within  the  array  of  POP  11/40  mini-computers, 

The  Four-port  buffer  memory  Is  a  4k  slice  of  semi-conductor  memory  which  can  be  shared  by  up  to  four  HOP 
11/40  processors.  All  segments  of  the  memory  can  be  accessed  by  each  of  the  PDP  11/40  processors. 

The  PDP  11  Super  Control  and  Display  Unit  Is  a  device  which  allows  for  the  control  of  up  to  three  PDP  1 l /40s 
from  a  fourth  PDP  11/40.  The  master  PDP  11/40  has  :.h«  capability  to  Interrupt  and  pass  data  to  each  of  the 
slave  PDP  1 1 /40s .  The  slave  POP  1 1 /40s  can  pass  data  to  the  master  PDP  11/40  and  can  also  Interrupt  the 
master  If  the  master  hasn't  disabled  the  Interrupt, 
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The  Controls  end  Backup  Instruments  System  (CBIS)  Is  the  Interface  between  the  PDP  11/40  and  the  DAIS  cockpit 
Information  such  as  stick  and  throttle  data  Is  provided  to  the  PDP  11/40  and  thus  entered  Into  the  simulation 

The  TCC  stick  and  keyboard  Is  an  Interface  which  allows  the  operator  to  fly  the  simulation  from  the  Test 
Conductors  Console  rather  than  from  the  cockpit. 

The  Console  Intelligence  Unit  (CIU),  In  conjunction  with  an  RS-232  channel,  Interfaced  with  the  PHC 
PDP  11/40.  D!X-10,  and  the  Hazeltlne  terminals,  provides  the  means  to  control,  and  load/change  DAIS  pro¬ 
cessor  registers  and  memory.  The  CIU  Is  supplied  by  the  DAIS  processor  vendor  to  support  the  debug  and 
test  of  the  mission  software  under  non-real  time  conditions. 

5.  SIMULATION  SUPPORT  SOFTWARE 

The  Support  Software  Is  divided  Into  two  basic  systems,  the  Performance  Monitor  and  Control  (PMC)  system  and 
the  Simulated  Subsystem  Data  Formatter  (SSOF)  System.  The  PMC  software  controls  those  Interfaces  required 
for  the  monitoring  and  control  of  the  DAIS  avionic  suite.  The  SSDF  software  Is  responsible  for  the  routing 
of  data  from  the  DAIS  core  elements  to  the  host  simulation  system. 

5,1  Performance  Monitor  and  Control  System 

The  Performance  Monitor  and  Control  (PMC)  software  has  the  capability  to  Initialize,  control,  and  monitor 
the  mission  software  resident  In  the  DAIS  processors  for  testing  and  evaluation  purposes  only.  The  PMC 
software  Is  resident  In  a  PDP  11/40  computer  and  supports  the  system  users  In  the  loading,  debugging,  and 
evaluation  of  mission  software  by  allowing  selective  real-time  and  non-real-tlme  gathering  of  data  from 
the  DAIS  processors  (AN/ATK-15s)  and  the  multiplex  bus.  The  PMC  Is  capable  of  servicing  from  one  to  four 
DAIS  processors  at  one  time  while  simultaneously  monitoring  the  multiplex  bus  traffic  via  the  BMU  and 
recording  selected  DAIS  system  data  for  post  test  analysis.  The  PMC  Is  capable  of  test  set  up  to  define 
the  processors  and  data  collection  for  a  simulation  run.  Through  an  Interactive  Interface  the  operator 
can  create  a  test  control  file  correlated  with  the  DEC- 1 0  simulation,  so  that  tht  collection  of  test  data 
can  be  mapped  with  the  progression  of  the  simulation.  The  PMC  provides  the  capability  to  restart  mission 
software,  along  with  the  simulation  modals,  from  a  system  snapshot  point.  This  Is  accomplished  by 
dumping  mission  software  parameters  at  a  specified  PMC  breakpoint,  and  reloading  these  parameters  to  re¬ 
start  thr  system.  This  snapshot  and  restart  capability  Is  used  for  repeated  testing  or  demonstrations  from 
a  specific  point  In  the  mission  profile. 

The  following  list  defines  the  non-real-time  and  real-time  functions  provided  by  the  PMCt 

(1)  Manipulate  files  on  the  DEC-10  and  PDP-11.  '  , 

(2)  Load  or  dump  DAIS  processor  mission  software  from  or  to  the  DEC-10  or  PDP-11. 

(3)  Sot  or  reset  program  path  breakpoints  when  the  DAIS  processors  are  halted. 

(4)  Start  and  stop  (halt)  the  DAIS  processors  and  BCIUs  (single  step  or  continuous 

execution). 

(5)  Set  up  and  control  the  SCADU  to  collect,  store,  and/or  breakpoint  on  ^e  data  received 
from  the  DAIS  processor,  and  then  halt  the  DAIS  processors  and/or  BCIUs,  and  Interrupt  the  PMC  PDP-11 /40. 

The  PMC  software  will  set  up  the  SCADU  for  real-time  operation  by  loading  the  SCADU  control  RAMs  with 
specific  microprogrammed  monitor  and  control  actions. 

(6)  Set  up  and  control  the  bus  monitor  to  record  or  breakpoint  on  specific  multiplex  data 

bus  messages. 

(7)  Display,  print  or  log  for  the  post  run  editor  data  collected  from  the  bus  monitor  or 
DAIS  processors  via  the  CIU  and  SCADU. 

(8)  Provide  capability  to  examine  or  modify  DAIS  processor  registers  and  mamory  locations 
either  with  absolute  or  symbolic  addresses. 

(9)  Provide  Interactive  capability  with  the  DEC-10  to  set  up  and  run  the  simulation  models. 

5.2  Simulated  Subsystem  Data  Formatter  System 

The  Simulated  Subsystem  Data  Formatter  (SSOF)  software  Initialises  the  simulation  Interface  between  the 
host  computing  complex  and  the  DAIS  core  elements.  The  SSDF  software  Is  resident  In  a  PDP  11/40  computer 
and  supports  the  system  simulation  b.y  mapping  data  from  the  mission  software  to  the  real-time  simulation 
models  executing  on  the  DEC-1 0.  The  SSDF  initialises  and  controls  the  URT,  double  buffers  the  data 
received/transmitted  via  the  multiplex  data  bus.  and  moves  this  Information  through  a  DMA-10  Interface  to 
the  simulation  models  within  the  DEC  10  complex.  Basic  throttle  and  stick  control  Information  Is  trans¬ 
ferred  from  the  cockpit  through  a  separate  Interface  to  the  SSDF  program  which  than  formats  the  Information 
for  utilisation  by  the  DEC-10  aircraft  models.  When  operating  In  real-time,  the  SSDF  software  performs 
the  following: 

(1)  Marks  the  start  of  each  minor  cycle  when  the  minor  cycle  mode  command  Is  received. 

(2)  Initialises  the  URT  to  transmit  and  receive  data  from  alternate  buffers  In  the  four 
port,  buffer  memory  each  minor  cycle. 


(3)  Moves  data  In  and  out  of  the  DEC-10,  DMA  window  from  the  four  port  buffer  memory. 

(4)  Sends  an  Interrupt  to  the  0EC-10  simulation  models  to  perform  a  computation  cycle. 

(5)  Inputs  and  outputs  the  CBIS  data,  converts  the  data  to  the  proper  format,  and  moves 
the  data  to  and  from  the  DEC-10  DMA  window. 

(6)  Updates  and  displays  minor  cycle,  user's  selected  RT/subaddress  messages  and  error 

conditions. 

(7)  Handles  mode  fommand  Interrupts  which  require  SSDF  software  to  configure  the  URT  to 
respond  like  a  real  RT. 

(8)  Inputs  and  outputs  the  TCC  stick  and  keyboard  data,  converts  the  data  to  tha  proper 
format,  and  moves  the  data  to  and  from  the  DEC-10  DMA  window. 

6.  EVANS  AND  SUTHERLAND  GRAPHICS  SYSTEM 

The  Evans  and  Sutherland  (EIS)  graphics  system  Is  used  to  generate  a  cockpit  out-of-window  scene.  The 
out-of-window  scene  1$  controlled  by  the  simulation  software  so  that  the  scene  viewed  from  the  cockpit  has 
the  correct  dynamic  orientation  to  synchronize  with  the  simulated  aircraft  motion,  The  graphics  Interface 
software  transforms  aircraft  attitude  and  position  data  obtained  via  the  DEC-10  DMA  window  from  tho  simu¬ 
lation  software  program  Into  a  form  that  can  drive  the  EES  graphics  system. 

A  typical  display  produced  by  the  EES  graphics  system  is  shown  In  Figure  4.  These  visual  displays  are 
generated  by  a  stand-alone  genera)  purpose  Interactive  computer  graphics  system  which  can  display  smoothly 
moving  pictures  of  two  or  three  dimensional  objects  effectively  In  real-time.  The  basic  components  of 
the  system  are  a  DEC  PDP-11,  and  the  following  manufactured  by  the  Evans  and  Sutherland  Computer  Corpora¬ 
tion:  hardwara  processing  units  which  perform  such  functions  as  rotations,  zooming,  and  perspective:  an 
8172-point  Refresh  Buffer:  a  Picture  Generator;  a  Character  Generator:  a  21  Inch  Picture  Display:  Inter¬ 
active  devices:  and  the  software  to  support  the  system. 

7.  HOST  COMPUTER  SOFTWARE 

The  Simulation  Software  Is  resident  In  the  DEC-10  host  simulation  processor  (Figure  S)  and  Is  the  real-time 
simulation  of  the  real  world,  the  aircraft  and  the  avionics  sensor  suite,  The  simulation  software  con¬ 
sists  of  a  simulation  executive  and  scenario  generator;  and  a  set  of  simulation  models. 

The  simulation  software  Is  programmed  In  Fortran.  Assembly  language  Is  used  for  modules  If  timing  or 
language  constrains  the  usage  of  the  module. 

The  simulation  operates  by  executing  computation  cycles  of  32  times/second.  Input/Output  data  Is  trans¬ 
ferred  to  and  from  the  PDP-11  processors  ones  each  computational  cycle. 

7.1.  Scenario  Generator  and  Simulation  Executive 

The  scenario  generator  provides  the  non-real-time  interface  with  the  system  user  during  the  Initialization 
stages  of  a  simulation  run.  By  means  of  Interactive  commands,  the  user  can  select  the  set  of  models  from 
a  library  for  the  mission  simulation  to  be  executed.  Also,  the  user  has  the  capability  to  change  the 
model  parameters  Individually  or  Initialize  all  the  parameters  from  a  pre-daflned  stored  file.  During  the 
real-time  simulation  run,  the  user  can  Inspect  any  of  the  simulation  parameters. 

The  simulation  executive  executes  the  selected  simulation  models  In  r> si-time  and  operates  under  the  DEC-10 
operating  system.  Input  and  output  parameters  from  the  simulation  moduls  are  passed  to  the  DEC-10  DMA 
window  for  the  SSDF  PDP-11. 

The  scenario  generator  Includes  the  capability  to  specify  model  parameters  to  be  recorded  during  a  real-time 
simulation  run.  The  parameters,  along  with  a  time-tag,  are  recorded  on  e  tape  which  can  be  processed  by 
the  post  run  editor. 

Also,  the  simulator  Includes  the  capability  to  record  the  complete  state  of  the  models  at  a  PMC  specified 
breakpoint.  This  snapshot  point  is  used  to  restart  the  models,  along  with  mission  software,  for  repeated 
testing  or  demonstration  from  a  specific  point  In  the  mission  profile. 

7.2.  Simulation  Models 

A  set  of  models  has  been  developed  which  represent  various  components  of  the  real  world  simulations.  The 
models  Include  earth  model,  dynamic  air  frame  model,  weapon  stores  models,  sensor/subsystem  models,  target 
or  IP  models,  environmental  models  nnd  weapon  scoring  model  to  perform  the  missions. 

7.3.  Post  Run  Editor 

The  Post  Run  Editor  (PRE)  performs,  the  final  phase  of  testing,  the  date  reduction  and  analysis  for  the 
support  facility  for  both  real-time  and  nun-real-time  simulation  data.  The  post  run  editor  provides  an 
Interactive  Interface  with  an  operator  to  define  the  variable  to  be  analyzed,  the  analysis  routines  and  the 
form  of  data  presentation. 


The  Input  to  the  post  run  editor  Is  Rough  Output  Tepes  (ROTs)  containing  the  data  from  various  sources. 

This  Includes  Inputs  from  simulation  runs  collected  by  the  PMC  software,  SSDF  software,  cockpit,  and  the 
simulation  models.  Data  collected  Is  user  Identifiable  and  (s  time-tagged  with  major/mlnor  cycle 
to  enable  PRE  to  relate  system  behavior  from  the  various  data  sources. 

8,0  Future  Efforts 

To  Increase  the  flexibility  of  the  Simulation  Support  Systam,  three  hardware  developments  are  needed.  With 
the  advent  of  bu*  structured  avionic  systems,  a  multiplex  universal  simulation  terminal  Is  needed  to  pro¬ 
vide  the  capability  of  controller,  monitor  and  multiple  remote  terminals.  Such  a  device  would  allow 
Integration  of  systems  and  subsystems  without  rellanca  upon  any  specific  architecture.  Another  tool  re¬ 
quired  for  the  system  (s  a  generalized  control  and  display  unit.  This  piece  of  Instrumentation  would 
provide  the  capability  of  monitoring  and  controlling  different  airborne  processors  developed  by  different 
manufacturers.  A  generalized  test  station  which  would  provide  the  basic  pilot  Interface  Is  also  required 
so  as  to  permit  avionic  system  architecture  evaluations  without  a  specific  cockpit  system  Implementation, 
This  Simulation  Support  System  and  the  planned  enhancements  provide  the  Air  Force  with  a  full  complement 
of  simulation  and  Integration  support  capabilities  needed  to  support  the  spectrum  of  design  and  integration 
activities  for  modern  avionics  systems. 
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SUMMARY 


The  paper  gives  a  short  survey  on  new  aspects  In  air-to-air  gunnery  which  were 
initiated  by  recent  improvements  in  gun  fire  control. 

Then  the  simulation  models  used  in  the  TKF  simulation  for  gun  fire  control  and  gun 
scoring  are  presented,  followed  by  some  considerations  on  the  necessary  and  the  possible 
detail  and  accuracy  of  the  implemented  models. 


1 .  INTRODUCTION 

The  introduction  of  the  digital  computer  and  new,  more  accurate  and  ECM-resistant 
monopuls  radar  sensors  with  frequency  agility  give  us  the  possibility  to  take  a  new 
approach  to  air-to-air  gunnery. 

The  digital  computer  gives  the  neoessary  compute  power  to  install  more  accurate 
ballistic  models,  elaborate  Kalman  filters  and  other  signal-processing  features  and  more 
elaborate  fire  control  computations. 

In  applications  like  AFTI,  F-18,  and  TKF,  all  or  some  of  these  features  have  been 
included  and  thoroughly  tested. 

The  net  effect  of  these  improvements  in  fire  control  can  be  an  increase  of  the 
effective  gun  range  from  the  1 000-to-2000-f t .  to  the  3000-to-500Q-foot  region  for  a 
20  mm  gun.  A  27  mm  gun  with  its  shorter  bullet  time  of  flight  can  roach  a  still  greater 
range . 

This  increase  in  rrnge  provides  new  tactical  capabilities  like  a  true  head-on  capa¬ 
bility  and  possibly  an  all-aspect  capability  with  the  guns. 

Furthermore  this  increase  in  range  closes  the  gap  between  maximum  gun  range  and 
minimum  missile  range  and  results  in  a  greater  kill  probability  on  close  ranges  than  a 
missile  usually  has  in  this  range. 

Developing  and  validating  the  full  potential  of  these  improvements  in  fire  control 
for  air-to-air  gunnery  require  a  manned  simulation  on  a  simulator  providing  a  realistic 
target. 

In  a  manned  simulation  the  loop  from  target  image  (optical  and  radar) ,  fire  control 
system,  head-up  display,  pilot,  aircraft,  gun  and  ballistics  to  the  score  can  be  defined, 
developed  and  evaluated. 

For  example,  the  information  display  for  the  pilot  in  the  head-up  display  can  be 
optimized,  or  a  fuselage  aiming  mode  can  be  tested  under  realistic  air  combat  conditions. 

In  these  ureas,  IABG  conducts  comprehensive  simulation  work  within  the  scop”  of  the 
TKF  project. 


2.  AVIONICS  SIMULATION  MODELS  FOR  AIR-TO-AIR  GUNNERY 
2 . I  INTRODUCTION 

In  our  simulation  work  on  air  combat  with  the  F-104,  F-4F.  F-106,  F-15  performance 
class  aircraft  and  the  TKF,  a  set  of  simulation  modelB  and  programs  for  air-to-air  gunnery 
has  been  developed. 

In  developing  these  programs,  we  made  some  interesting  experiences  which  seemed  to 
repeat  themselves  whenever  we  started  u  new  program. 
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Whenever  there  is  the  possibility  to  solve  a  mathematical  problem  either  in  a 
closed-solution  one-step  approach  or  in  an  iterative  process,  the  latter  usully  is  more 
economical  in  compute  time  and  often  easier  to  install  than  the  former. 

Real-time  programs  should  bo  structured  and  written  from  the  first  line  for  real¬ 
time  operation.  It  usually  proves  very  difficult  to  convert  batch  programs  into  efficient 
real-time  programs  and  it  takes  more  time  than  rewriting  them  completely. 

Real-time  programs  should  be  written  in  a  modular  structure  to  keep  them  flexible 
and  transparent. 

Whan  we  can  write  either  a  deterministic  or  a  describing  (stochastic)  model,  the 
latter  tends  to  take  less  compute  time,  while  the  former  gives  us  the  necessary  insight 
into  the  system. 

In  the  following  paragraphs,  some  features  of  the  sensor  model,  a  short  description 
of  the  gun  fire  control  system,  and  the  scoring  model  implemented  In  the  TKF  study,  are 
discussed. 


2.2  OUTLINE  OF  THE  REQUIRED  SENSOR  MODEL 

In  applications  like  AFTI  and  TKF,  all  the  aiming  of  the  gun  is  done  by  the  fire- 
control  system.  So  the  angle-tracking  accuracy  of  the  sensor  beoomes  very  important.  In 
the  following  only  «  radar  sensor  will  be  considered. 

For  close-in  ranges,  the  biggest  angular  tracking  error  is  induced  by  glint.  This 
mainly  disturbes  the  velocity  and  acceleration  outputs  of  the  Kalman  filters. 

These  velocity  and  accele ration  errors  also  make  the  biggest  oontribution  to  the 
overall  error  budget  of  the  lead-angle  computation.  Therefore  glint  effects  have  to  be 
simulated  very  carefully.  A  deterministic  glint  model  which  represents  the  target  by  a 
number  of  beckscatterers  and  computes  the  resulting  return  Bignal,  would  be  highly  de¬ 
sirable,  especially  against  hard-maneuvering  targets,  where  effective  glint  magnitude 
and  bandwidth  can  be  affected  by  target  rotational  movements. 

But  this  still  requires  more  computing  time  than  can  be  spent  within  a  comple.'; 
simulation.  So  a  stochastic  glint  model  is  the  remaining  choice  where  calibrated  noise 
is  added  to  target  position  in  an  antenna  coordinate  system.  The  tracking  dynamics  of 
the  antenna  and  the  break  lock  of  the  antenna  also  muBt  be  simulated. 

A  monopuls  radar  with  frequency  agility  over  a  sufficient  bandwidth  and  with  a 
pulse  repetition  frequency  of  a  least  serveral  kHz  must  be  chosen  to  get  the  deBired 
angle-tracking  accuracy. 

The  readouts  of  the  radar  are  azimuth  angle,  elevation  angle  and  range, measured 
in  antenna  coordinates.  The  readouts  are  fed  into  the  Kalman  filter.  To  save  computation 
time,  filtering  is  done  in  the  geodetic  coordinate  system.  In  the  real  aircraft,  another 
coordinate  system  may  be  necessary  due  to  available  data  Inputs,  data  rate  limitations 
induced  by  frametime,  and  accuracy  limitations  induced  by  limited  word  length  in  on¬ 
board  computers. 

The  readouts  of  the  Kalman  filter  are  geodetic  position,  velocity  and  acceleration 
of  target,  and  steering  commands  for  the  radar  antenna. 

Own-ship  inertial  navigation  and  airdata  and  Kalman  filter  readouts  are  fed  into 
the  fire  control  computation. 


2.3  GUN  FIRE  CONTROL  COMPUTATION  MODEL 

2.3.1  FUNCTIONS 

The  fire  control  computation  performs  several  functions: 

compute  bullet  time  of  flight 

-  extrapolate  target  flight  path  until  collision 

-  compute  commanded  gun  barrel  line  for  firing 
compute  aiming  pipper  position  in  head-up  display 
compute  in-range  conditions 

The  fire  control  system  is  a  director  sight  system,  i.u.  all  informations  on  the 
target  are  based  on  the  radar  sensor. 

2.3.2  BULLET  TIME -OF- FLIGHT  COMPUTATION 

The  bullet  time-of-f light  couipuation  and  compuation  of  bullet  gravity  drop  are 
based  on  the  shooting  tables  of  the  ammunition  used.  The  actual  velocity  time  history 
for  the  given  conditions  of  launch  velocity,  altitudes  of  launcher  and  target,  and  mach 
number  are  approximated  by  two  constant  deceleration  sections.  The  four  parameters  of 


this  model  are  adjusted  to  the  launch  conditions  by  correction  functions  (App.  A  2.2.1). 

This  velocity  time  history  can  be  integrated  directly  up  to  the  measured  radar 
range,  giving  the  first  approximation  for  the  bullet  time  of  flight  (App.  A  2.2.2). 

In  a  second  step,  the  target  velocity  along  the  line  of  sight  is  taken  into  conside¬ 
ration  to  get  a  better  estimate  of  the  lenght  of  the  bullet  flight  path.  (App.  A  2.2.3) 

Then  the  target  velocity  normal  to  line  of  sight  is  included,  which  already  provi¬ 
des  a  relative  accurate  bullet  time-of-f light  estimate  (App.  A  2.2.4),  Now  the  whole 
bullet  time-of-f light  computation  is  repeated  with  the  last  estimate  of  the  flight  path 
length  as  the  starting  value. 

The  accuracy  of  this  procedure  is  good  enough  to  meet  the  aoouraoy  of  the  shooting 
tables.  The  bullet  time  of  flight  is  limited  to  4  seconds. 

2.3.3  EXTRAPOLATION  OP  TARGET  PLIGHT  PATH  TO  COLLISION  POINT  AND  COMPUTATION  OF 
DESIRED  GUN  POINTING  VECTOR 

The  extrapolation  algorithm  uses  the  position  of  the  target  in  geodetic  coordinates 
from  the  Kalman  filter  and  the  bullet  time  of  flight  as  inputs.  (App.  A  2.3) 

To  improve  the  effectiveness  of  extrapolation,  the  gradients  of  the  target  accelera¬ 
tions  in  a  target-based  coordinate  system  are  computed  and  included  into  the  extrapola¬ 
tion  algorithm. 

Then  the  target  position  at  impact  is  extrapolated  in  a  few  integration  steps.  This 
allows  to  take  into  consideration  movements  of  the  target  from  its  original  plane, such  as 
barrel  roll  motions. 

These  combined  features  result  in  an  improved  firing  capability  against  targets  th«t 
do  evasive  maneuvers. 

From  the  target  impact  positiin,  own-ship  velocity  vector,  gravity  drop  vector  and 
medium  bullet  velocity  wo  compute  the  desired  gun  pointing  vector. 


2.3.4  COMPUTATION  OF  AIMING  PIPPER  POSITION  IN  THE  HUD 

The  computed  target  impact  point  is  the  sum  of  the  gun  pointing  vector  times  the  me¬ 
dium  bullet  velocity  plus  the  gravity  drop  vector  plus  the  own-ship  velocity  vector. 

(App.  A  2.4). 

When  the  extrapolated  target  flight  path  vector  until  impact  is  subtracted  from  this 
value,  we  get  the  position  of  the  aiming  pipper  in  geodetic  coordinates.  The  line  of 
sight  from  the  attacker  to  this  point  defines  the  pipper  position  in  the  HUD  coordinate 
system, 

2.3.3  IN-RANGE  COMPUTATION 

Maximum  gun  range  is  limited  by  two  factors.  The  impact  velocity  at  the  target  must 
be  above  a  curtain  value  to  trigger  the  fuze,  and  the  terminal  velocity  of  the  bullet 
must  be  still  supersonic,  otherwise  the  bullet  becomes  unstable. 

The  first  limitation  governs  the  tail  chase  cases,  Lhe  second  the  head-on  cases. 

The  actual  shooting  ranges  may  be  much  shortos  due  to  dispersion,  and  evasive 
maneuvers  of  the  target. 

2.4  SCORING  MODEL 
2.4.1  INTRODUCTION 

First  the  necessary  detail  in  a  gun  fire  scoring  model  is  discussed. 

The  vulnerable  area  of  an  average  fighter  plane  from  the  front  or  rear  is  about 
3  mJ  .  Exactly  from  the  Bide,  this  goes  up  to  about  20  mJ  and  from  above  or  below  it 
amounta  to  about  60  mJ  .  So  there  is  a  factor  of  twenty  in  the  exposed  target  area. 

Furthermore  the  kill  probability  of  a  single  round,  given  a  hit,  can  vary  more  than 
ten  to  one  depending  on  its  impact  point  and  angle,  and  the  caliber  used. 

When  there  are  multiple  hits  on  the  same  area,  the  bullets  at  the  end  of  the  salvo 
have  a  lower  kill  probability  than  the  ones  at  the  beginning.  So  a  sort  of  saturation 
effoct  must  be  taken  into  account. 

All  these  effects  combined  can  produce  misleading  results,  if  the  actual  shape, 
size  and  kill  probability  distribution  is  not  used  for  scoring.  Some  of  these  effects 
but  not  all  of  them  can  be  levelled  out  by  an  excessive  number  of  runs-.  So  a  scoring 
model  should  go  into  considerable  detail  to  avoid  these  pitfalls. 


2.3.2  COMPUTATION  OF  MISS  DISTANCE 


Miss  distance  is  computed  mainly  to  give  a  measure  of  accuracy  of  the  fire-control 
system  in  the  real  environment.  (App.  B  2.1) 

To  reduce  the  storage  requirements  of  the  program  in  the  fire  oontrol  subroutine, 
the  extrapolated  collision  point  is  computed  and  stored  in  a  ring  together  with  the  bul¬ 
let  flight  path  vector  at  this  point  and  the  bullet  impact  time. 

The  miss  distance  then  is  defined  as  the  vertiaal  distance  of  the  target  center  of 
gravity  from  the  bullet-relative  flight  path  vector  at  the  extrapolated  collision  point. 
Because  of  the  long  frame  time  of  50  milliseo,  the  target  position  at  collision  time  must 
be  interpolated  from  the  frame  time  values. 

The  relative  flight  path  vector  or  impact  velocity  vector  (App.  B  2.3)  must  be  ta¬ 
ken  instead  of  the  geodetic  flight  path  vector  to  aeoount  for  the  relative  motion  of  the 
target  and  salvo  at  the  moment  of  passing.  In  this  way  the  computation  produces  the 
smallest  miss  distance  actually  occurring  independently  of  the  time  of  passing. 

2.4.3  COMPUTATION  OF  HIT  PROBABILITY 

The  hit  probability  is  computed  for  every  frametime  from  the  actual  target  flight 
path  and  attitude,  and  the  actual  gun  firing  data. 

2.4.3. 1  TARGET  MODEL 

The  target  is  represented  by  a  simplified  model  which  approximates  the  shape  and 
dimensions  of  the  actual  target  projection  into  a  plane  perpendicular  to  the  impact 
velocity  vector. 

The  model  area  is  composed  of  some  ten  to  thirty  subareas.  These  subareas  define 
th©  shape  and  dimensions  of  the  model  area.  Each  of  them  gets  its  own  aapture  area  and 
kill  probability  value. 


2. 4. 3. 2  HIT  PROBABILITY 

Now  the  average  hit  probability  density  for  every  subarea  is  computed  from  the  dis¬ 
persion  function.  From  thin,  the  total  hit  probability  can  be  added  up.  (App.  B.2) . 

2. 4. 3. 3  KILL  PROBABILITY 

,  ...  multiplying  the  individual  hit  probability  of  every  subarea  with  its  single  shot 
Kill  probability,  and  by  computing  the  weighted  total,  we  get  the  total  kill  probability 


3 .  CONCLUSION 

A*  aan  be  Been  from  thu  sensor,  fire  control  and  scoring  simulation  models  as  used 
in  the  TKF  study,  the  complexity  of  the  simulation  makes  a  quantum  jump  as  soon  as  auto- 
*"”10  firing  modes  are  eimulated.  Expecially  when  automatic  firing  modus  are  compared 
with  manual  firing  modes  there  are  very  exacting  requirements  on  the  accuracy  and  fide¬ 
lity  of  a  simulation. 

The  outlined  models  worked  well  in  the  TKF  simulation  and  compared  favorably  with 
different  studies  on  other  facilities.  On  the  other  hand  there  are  still  a  lot  of  fac- 
tors  not  accounted  for,  such  as  special  propagation  effects  and  ECM  conditions,  which 
could  lead  to  another  quantum  jump  in  the  complexity  of  the  required  simulation  models. 

But  this  would  require  also  a  quantum  jump  in  compute  power,  if  it  had  to  be  done 
in  real  time. 
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SENSOR  MODEL 

RADAR:  MONOPULSE 

FREQUENCY  AGILITY 
10  FREQUENCIES  (MINIMUM) 

20  MHZ  SEPARATION 
HPRF  (10  KHZ) 

READOUTS:  AZ,EL, RANGE 

GLINT  MODEL:  stochastic 

(NOISE  ADDED  TO  TARGET 
POSITION) 

ANTENNA:  tracking  dynamics, break 

LOCK  SIMULATED,  READOUTS: 
DISTURBED  AZ,  EL, RANGE 

KALMAN  FILTER :  readouts:  position 

VELOCITY  OF  TARGET 
ACCELERATION 
STEERING  COMMANDS  FOR 
RADAR  ANTENNA 


DIRECTOR  SIGHT 


1.  SENSOR 


TYPE: 

RADAR 

RANGE: 

10km  PLUS 

FIELD  OF  VIEW: 

170*  VERTICAL 

IFOR  TRACKING) 

160°  HORIZONTAL 

LEAD  ANGLE  COMPUTATION 

2.1  GUN  RANGE  LIMITATIONS 


IMFACT  VELOCITY  (FUZE) 

AND  BULLET  TIME  OF  FLIGHT 

(TERMINAL  VELOCITY  SUBSONIC 
—►BULLET  UNSTABLE) 

2.2  BULLET  TIME  OF  FLIGHT 


2,2,1  VELOCITY-TIME  HISTORY  IS  ADJUSTED  TO 

LAUNCH  VELOCITY,  ALTITUDE,  MACH  NUMBER 


2.2.2  INTEGRATION  OF  V  (t)  HISTORY  UP  TO 
RADAR  RANGE 

ST“i(V«1-SQRT(  V01-»2-(2.*B1»FW)))/B1 
VEND-V01-B1»ST 

2.2.3  ITERATION  INCLUDING  CLOSING  VELOCITY 
VZL 

ST"’-  ST“*(ST".VZL)/(VEND-VZL) 


2.2.4  ITERATION  INCLUDING  TARGET  VELOCITY 
V.Q  NORMAL  TO  LINE  OF  SIGHT 


TARGET  VELOCITY 


PREDICTED  COLLISION  POINT 


F  W®-SQRT(  FW"»*  2*(VQ»ST“)* « 2) 
STm-  ST®*(F  W®-  F  Ww)/  VEND 
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COMPUTATIONS  OF  2.2  ARE  ITERATED 
TWICE, FOR  RANGES  BEYOND  MAX. 
RANGE  ST  IS  SET  TO  ST  MAX. 

2.3  COMPUTATION  OF  DESIRED  GUN 
POINTING  VECTOR 


*ST 


I  EK-yjjgl^TMtOS*  (VT(t)dt  -V-ST-G--^p  ) 

'  * 

COMPUTATION  OF  TARGET  IMPACT  POSITION 
(TIP)  INCLUDES  GRADIENT  OF  TARGET  ACCELER- 
;  J  ATION  AND  BARREL-ROLL  MOTIONS  OF 

.!*  1  THE  TARGET 


K 


APPENDIX  B 


SCORING 


1.  FIRST  A  HIT  PROBABILITY  IS 

COMPUTED  ,  THEN  A  KILL  PROBABILITY  IS 

COMPUTED, WHICH  INCLUDES  A  VULNERA¬ 
BILITY  MODEL  OF  THE  TARGET 


2.  METHOD 

2.1  TARGET  MODEL 


TARGET  IMAGE  WITH 
OUTLINE  DIMENSIONS 
C.G.TARGET  OF  TARGET 

MISS  DISTANCE  IEQUAL  AREAI 
/ 

CLOSEST  POINT  C.P. 


g  ^FLIGHT  PATH 


2.2  COMPUTATION  OF  MISS  DISTANCE 

2.3  COMPUTATION  OF  TARGET  CAPTURE 
AREA 

NORMAL  TO  BULLET  IMPACT  VELOCITY  VECTOR 


2.4  DISPERSION  FUNCTION  OF  BULLETS 
IN  SALVO 

DISPERSION 

16  *  (90%  HITS! . 


2.5  INTEGRATION  OVER  CAPTURE  AREA 


OUTLINES  OF  TARGET  IMAGE  PROJECTED  ON  SALVO 
FOOTPRINT 

COORDINATE  TRANSFORMATION  TO  GET  CIRCULAR 
SALVO  FOOTPRINT 

NUMERICAL  INTEGRATION  OVER  18  MESH  POINTS 

LOCATION  OF  HITS  ON  TARGET  AND  ASPECT 
ANGLE  ARE  AVAILABLE  FOR  KILL  PROBABILITY 
COMPUTATION 


3.  COMPUTATION  OF  KILL  PROBABILITY 


-  BASED  ON  A  DETAILED  VULNERABILITY 
MODEL  KILL  PROBABILITY  PER  FRAME  TIME 
IS  COMPUTED 

-  COMPUTATION  INCLUDES : 

-  LOCATION  OF  HITS  ON  THE  TARGET 
-IMPACT  ANGLE  OF  HITS 
-VULNERABILITY  OF  IMPORTANT  TARGET 
AREAS 


35-1 


RESUME  l 


SIMULATOR  POUR  INTEGRATION 


AVEC  TESTS  DYNAM1QUES  DES 


LOGIC IELS  DE  CALCULATEURS  CENTRAUX  ENBARQUES 

8.  BOUTHORS 

ELECTRONIQUE  MARGE  I .  DASSAULT 
9221 A  SATNT-CLOUD 


II  s'uglt  d'un  systSme  convu  pour  aimuler  1 'environnoment  de  oalculataurs  embarquSs 
et  Eournlr  les  moyena  do  controls  permattant  In  miae  au  point  ot  la  validation  das 
iogieieln,  avant  integration  effective  dea  calculatsura  dans  l'ensembla  dal  fquipp- 
menta  rdela  snviroimanta. 

La  caractdristique  eaoentielle  du  nystSme  eat  de  siinuler  cea  Squipements  environ- 
nanta,non  paa  au  niveau  de  leur  fonctiormament  IntrinsSqiie,  mate  S  celui  de  laur 
interface  avec  le  calculateur  dana  lea  aapecta  temporal,  interactif  et  information- 
nel. 

La  simulation  ae  fait  par  fusion  d'informations  opdrateur  et  d' informations  enre- 
giatrdes  sur  bande  magn6t:que.  Cea  derniirea  simulent  lea  diffHventaa  phases  de  vol 
envisages  pour  lea  tests  tandis  quo  lee  informations  opdrataur  reerdont  an  tamps 
rdel  les  actiona  du  pilots  et.  les  pannea  d'fiquipsment. 

Dea  possibilitSe  de  foncticmnement  en  ralenti  at  pas  &  pas  confBrent  jna  efficacitd 
toute  particullOre  B  catte  simulation  pour  la  mise  au  point  et  la  validation  das 
logiciels. 
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CHAP! IRE  I 


INTRODUCTION 


L'ELECTRONIQUE  MARCEL  DASSAULT  (EMD)  cat  apRcialiaJa  dqna  l'Ctf 
d'lquipamanta  dlectroniquea  do  points,  tant  dans  la  domaine  ini 


uda,  la  divaloppaaant  at  lu  fabrication 
liteira  qua  dana  la  domains  civil. 


L'affactif  da  l'EMD  aat  da  2.500  pareonnaa,  dont  1.400  ingdniduri  at  cadraa.  L* inforoatiqua  alroapatiala 
(culeulataura,  bus  numRrlquae,  ayatlmee  digitaux,  logicials  da  baaa  at  d'application)  conatitua  una  daa 
activitta  principals!  da  l'ELECTRONIQUE  MARCEL  DASSAULT  !  20  R  25  X  du  chiffra  d’affsiraa  ait  r<alia<  dana 
ca  domains, 


Dapuia  1965,  Ipoquo  R  laquello  l'EMD  n  confu  la  pramiar  celeulateur  aobarqut  europlan  utiliaant  daa  circuits 
intSgtle,  laa  miaiilaa  baliatiquaa  franqaia  aont  Iquipfia  da  cilculataura  univaraala  EMD,  pula  EMD-SAGEM  R 
la  suite  d'accorda  da  cooperation  aigtil*  antra  laa  doux  aocilkdi. 


En  1976,  l'accroieaamant  daa  baaoina  an  matiRra  da  puiaaance  de  calcul  conduit  l'EMD  R  promouvoir  an  Franca 
da  nouvallaa  tachnologie*  da  compoiant*  at  de  circuits  pour  crier  una  nouvtlla  glnlration  da  calculataurl 

universe lc  i  j 

-  1084  pour  miseilaa  baliatiquaa,  j 

-  MI82  pour  avion*  MIRAGE  FI,  j 

-  2084  pour  avion*  MIRAGE  2000. 


Le  ayitinw.  da  transmi aaion  de*  information!  numlriquea  S  bord  de  ces  avion*  a  lui  auasl  It!  drtvaloppO  par 
EMD  1  c'aat  i*  bu*  numlrique  GINA  (DIQIBUS) . 


L'EMD  rlaliae  Igjlemsnt  toui  las  logiaiela  du  baaa  at,  sous  la  mattrlae  d'oauvra  da  aaa  cllanta,  la  plupart 
daa  logioiala  d'application  concemant  aaa  proprt  i  calculataura  alroapatiaux.  L' introduction  de  la  nouvtlla 
glnlration  da  calculataura  EMD  en  tant  qua  calculataura  prlneipeux  daa  avion*  MIRAGE  El  et  MIRAGE  2000 
dlvaloppe  conaidlrablement  certe  activltl  logiciel. 

Laa  logiciele,  dana  lea  application*  aviouiquea,  ont  prlaantl  deux  cfiraotlrietiquea  i  d'una  part,  un  volume 
et  une  complaxltl  trfta  important*  ,  d'autre  part,  la  nScessitf?  de  livrer  coa  logiciel*  temp*  ilal  aana 
diapoaer  en  ualne  d'un  ayatbme  cnwplat  pour  In  mi:e  au  point  et  la  validation. 


Pour  faire  fac*  R  ce*  uouvellae  contraintea,  lea  efforts  ont  ports  danr  deux  diractions  8 

-  l'tmploi  d' une  mlthodologi*  de  dlveloppement  trRa  rigoureuae  qui  a  fait  l'objet  d'un*  communication  au 
sympoelum  AGARDda  OTTAWA  en  Mai  1979  (expo*!  53), 

-  la  dfveloppamant  d'outila  da  taata  at  da  validation.  Ces  outlie  ayant  pour  but  da  permettre  la  iourniture 
da  logiciela  da  trRa  grande  qualltl  grlce  R  leur  mia*  en  oeuvre  prfalabl*  dent  un  environnament  eimull, 

Avant  da  dlorire  la  aimulation  de  cat  envirennatnent,  iljeat  ndeeasaire  d'en  prlcieer  le  context*  j  d'un# 
part,  lea  fonctiona  du  calculator  principal  dana  un  ayitime  d'armaa  avioniqua,  d'autre  part,  let  contrain¬ 
tea  do  realisation  d'un  outil  de  teite  dynamiquea  et  de  validation. 


* 


OHAPXTRE  XI 


Bien  qua  toua  cei  Iquipamanta  comportent  tine  pnrt  da  plus  en  plus  grande  d'llectronique  numlrique, 
c'eet-S-dire  da  procetsaura  aplcislisls  ec  trfes  intlgrls  au  matlriel,  las  calculs  effectuea  y  sont  da 
nature  difflrante  da  ceux  du  calculataur  principal  :  11a  aont  splcifiques  de  1 ' Iquipement ,  contribuent 
dlractanant  I  aes  parf omancat  at  na  traltent  glniralemant  qua  daa  donnlea  locales. 

Au  contrairs,  la  logiclal  du  calculataur  principal  intervlant  au  niveau  global  du  ayatlma  da  faqon 
ralativenant  indlpandanta  daa  caractlristiqusa  particulilraa  daa  Iquipamanta,  II  assure  daux  types  da 
fonctiona  t 

-  de|_fonccion»_de_gastion_cantralisle  (Ichangas  d' information,  aurvaillanca  du  fonctionnament 
d'snsambla)  l 

La  s chime  fait  apparaltra  la  role  particular  du  bus  numlrique  ou  "digibus"  auqual  sont  connachls 
la  plupart  daa  Iquipamanta  du  ayatlma  d'arnaa.  Ltn  informations  Ichanglas  antra  oaa  Iquipamanta 
transitant  sur  cette  liaison  sous  forma  numlriqua  at  aulvant  un  mods  da  multiplaxago  temporal  k 
haute  frfiquense.  Las  liaisons  directaa  antra  iquipamanta  aont  de  plus  an  plus  raros  l  il  an  aubaista 
encore  qualquaa  unaa  pour  difflrentaa  raisons  (survivanca  da  tachniquaa  analogiquaa,  dibit  d'infor- 
mationa,  alcuritl). 

La  geation  du  bua  numlriqua  eat  aaaurle  par  la  calculataur  principal.  In  ays time  paut  aussi  fitra 
Iqutpl  d'une  unitl  aacondaira  (USG)  qui  glre  la  bua  an  caa  da  dlfaillance  du  calculataur  principal. 

-  <jea_fscctions_S2i{gtioQnallef  i  i  partir  daa  donnlaa  lliborles  par  lea  capteurs  at  daa  ordrua  intro- 
duita  manual lamant  aur  las  poates  da  commandos  par  la  pilots,  la  calculataur  principal  affactua  un 
certain  nombre  de  traitamenta  parmattant  d'aBturar  las  misaiona  oplratiannellea  da  I'avion  t  naviga¬ 
tion,  attaque  Air-Sol,  attaque  Air-Air;  aulvant  la  miaalon,  certains  rfisultata  da  calculs  sent  adrea- 
ala  I  daa  Iquipamanta  comma  lea  circuita  d'armamant,  d'autrua  informations  aont  prlaantlaa  au  pilots 
aur  leu  postea  da  visualisation.  Dana  quelquaa  caa,  une  pa-tie  do  ces  traitamenta  aat  affactula  par 
daa  calculateura  implantla  dans  la  radar  ou  la  viaaur  par  example.  L'unitl  de  geation  aacondaira 
(USG)  assure  certainea  da  caa  fonctiona  oplrationnallea  at  joue  ainsi  le  role  d'un  diuxiima  calcula¬ 
taur  principal. 

2.2.  CONTKAINTES  DE  LA  REALISATION  D'UN  OUTIL  DE  TESTS  PYNAMIQUES  ET  DE  VALIDATION 

-  La  contrainte  eaientielle  eat  le  dllai  qui  oat  encore  plua  court  que  pour  le  logiciel  erabavqufc.  D'une 
part,  lea  specifications  (mutlriel  logioiel)  ne  aont  rlaliaables  que  lorsque  celleB  lu  ayatlme  avioni- 
que  aont  terminlea,  d'nutre  part,  l'outil  doit  Etre  disponible  avant  le  dlbut  dea  teats  dynamiquea 

du  logiciel  embarqul. 

-  Le  coQt  ou  I'ltat  de  dlveloppemant  dea  Iquipamcnta  rlola  du  ayatlme  lend  cea  derniurs  indiaponiblea 
chat  la  fabricant  de  logiciel  . 

-  Enfin,  le  coQt  du  matlriel  impose  une  certains  standardisation  dea  moyens  de  teats  entre  laa  diffl- 
renta  projeta. 
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CHAl’ITRE  III 

L'OUTIL  DE  SIMULATION  POUR  I.* INTEGRATION  ET  LA  VALIDATION 

DES  LOGICIELS  EMBARQMES  t  LA  BAIE  DE  VALIDATION  DE  LOGICIEL 

L' out il  dfivaloppl  par  EMC  pour  1' intlgration  at  la  validation  daa  logiciala  embarqula  porta  la  nou  da 
"Bala  da  Validation  da  Logicial".  Par  la  suite,  il  aara  roprfiaent*  par  aon  eigle  :  BVL, 

3.1.  OBJEliTlFS 


.  Il  a'agit  d'abord  da  mattre  au  point  dee  fonctions  oompl.Staa  at  da  laa  taatar  dans  laur  configuration 
temps  rSel, 

Catta  phase  de  miaa  au  point  viant  aprbs  la  phasa  da  teats  atatiquas  qui  a  parmia  da  vfirifier  la 
partia  algorithmique  du  logiciel.  Pour  cea  teats,  il  eat  ndcaaaaira  da  aa  dotar  da  moyena  d' investi¬ 
gation  plus  filaborfia  qua  lea  moyans  clasaiqiica, 

.  Lea  logiciala  livrfia  dnivent  fitre  an  conformity  avec  lea  clauaea  techniques  qui  aont  appelfiaa  "apdoi- 
fiuationa  ddtaillfiea  du  logiciel".  Cette  conformity  eat  aaaurde  grace  aux  opirationa  da  validation. 
Four  vallder,  il  faut  done  foumir  au  logiciel  dee  informations  confomea  h  eelles  ddcritaa  dans  laa 
•pficificationa  dfitaillfies  du  logiciel.  D'autre  part,  il  faut  avoir  des  poseibilitda  da  visualisation 
pour  n ' nsaurcr  de  la  conformitfi  des  rfiaultata  obtanua. 

.  Laa  operations  dficrltea  ci-deasus  doivent  fitre  rSaliefiaa  par  la  fabriennt  da  logiciel  da  mani&re 
autonome,  c'est-S-dirn  qua  la  logiciel  ne  doit  paa  fitre  tributoire  du  dfiveloppement  ou  de  la  diaponi- 
bilitfi  dea  autres  fiqulpemonta  du  systfime  avionique.  Par  ailleurs,  il  aerait  mauvaia  da  monopoliser 
la  banc  d' integration  de  l'avion  pour  la  miae  au  point  du  logiciel. 

3.2.  PRINCIPES  GENERAUX 


Le  grand  principe  da  base  eat  da  faire  axficutar,  an  using,  le  logiciel  opdrationnel  dana  un  calcula- 
teur  ambarqud  rfial. 

Lea  contraintea  qui  an  rfisultent  sont  lea  suivantas  i 

-  toue  lea  moyena  da  controle  et  d' inveatigatlon  doivent  fitre  axtdrieurs  au  logiciel  opSratlonnel. 

-  1  'environnement  simulfi  du  calculateur  doit  reflfitar  fidMement  1 'environnement  opfiratlonnel . 

-  lea  chronogrammes  d'exdcution  et  d'fichangeB  d1  information  doivent  fitro  auaai  proehea  que  possible 
des  conditions  opfiratlonnel loa. 

11  ne  faut  paa  perdre  de  vue  qu'il  a'agit  de  raise  au  point  de  la  validation  de  logiciel.  Lora  de 
1' analyse  de  1' environnement  4  simuler,  il  ne  faut  done  pas  s'attacher  au  fonctioimement  da  cheque 
fiquipement  mala  4  sea  relations  avec  le  logiciel  4  vnlidur. 

Knfin,  l'outlt  devra  fitre  commode  et  simple  d'umploi,  en  particular,  il  n'est  pas  recherchfi  une 
correlation  nutomatiqua  avec  des  resultats  pre-enregistrfiB.  La  validation  aat  aesurfie  per  l'opfira- 
teur  qui  a  la  possibility  d'udapter  en  permanence  le  niveau  de  controle,  du  plus  global  au  plus  fin. 


3.3.  SOLUTIONS  ADOPTEES 


a)  Simulation  das  information!  an  antrl* 

La  bilan  daa  information*  amln*  A  laa  claaaar  an  daux  typaa  t 
.  information*  iaaua*  da  oaptaura  at  lila*  1  la  march*  da  l'avion  (UNI.  CAl,..,). 

.  information*  aliatoiraa  i*«ua*  d'iquipa manta  ou  da  conaandaa  pilot*  (poata*  da  cosoanda,  Itat*  da 
pannaa . . . ) . 

L'amaobl*  da  oa*  daux  typaa  d' information*  act  1  raatituar  da  mantlra  dynamiqu*  at  cohlranta  a  vac 
laur  format  rdal. 

Un  fichiar  elquantial  (band*  da  vol)  contanant  la*  information*  "oaptaura"  aat  crll  an  contra  da 
calcul.  La*  information*  aldatoira*  *ont  gtnlrlaa  an  tamp*  rial  aur  la  bai*  da  vadilation  du  loglolal 
par  aimulation  da*  poitaa  da  conmand*  at  da*  mot*  d'ltata  d'lquipament*. 

b)  ContrOl*  du  dlroulamant  du  lcglclal 

La  contrfila  du  dlroulamant  du  logicial  aat  fait  diractamant  par  action  *ur  la  matlrial  du  calcula- 
taur  ambarqul. 

Ca  contrSl*  par  la  matlrial  parmat  done  d'arrltar  1*  oalculataur  can*  affactar  l'atpaot  tampa  rial. 
L'lchalla  da  tamp*  lllmantaira  du  lyitlmc  (la  cycle  court  ■  20  ml)  nonatitu*  l'lllmant  da  baaa  da  la 
aimulation.  Catt*  poaaibilitl  parmat  d'arrltar  1*  procaiaua  (Idition  da  rlaultat*.  observation)  at 
da  la  raprandr*  an  alquinc*.  En  particular,  il  faut  notar  la  poiiibilitl  da  tonctionnar  au 
ralanti  ou  au  pa*  1  pa*. 

c)  Moyen*  d'obaarvatlon 

Daux  typaa  d'obiarvation  aont  mi*  I  la  diapoaition  da  l'oplrataur  < 

“  contrSl*  par  Icrnn 

L'avantag*  da  ca  diapoaitif  ait  da  pouvoir  aurveiilar  1'lvolution  dan  paramttra*  an  taap*  rial. 
L'oplrataur  paut  dlfinir  laa  Information!  qu'il  couhait*  voir  aur  l'lcran  grtc*  1  un  programme 
oonvariationna 1 .  La  contrfila  paut  Itra  rlalial  au  nivaau  global  par  obcarvation  daa  phlnomlna* 
tala  qua  la*  voiant  laa  utiliaataura  oplrat.ionnal*  (viiaur  aimull.  po*t*  da  command*  itmull). 

La  contrfila  paut  Igalamant  a*  aituar  au  nivaau  daa  interfaces  d'antrla/aortiaa  quo  l'oplrataur 
paut  viaualiaar. 

Enfin,  la  ayatlnw  parmat  d'obaarvar  daa  information*  interna*  jul  n'ont  pa*  d'exiitanoe  phyaiqua 
au  nivaau  daa  intarfacaa.  En  particular,  una  liata  da  contanua  mlmoira  paut  Itra  obcarvt*  an 
parmanance . 

-  contr81*  par  imprimanta 

L'oplrataur  dlfinit  an  oonveraationnel  la*  information*  at  1*  format  qu'il  (ouhaita  Iditar.  Daux 
poaaibilitla  a'offvent  I  lui  i 

-  dlclanohar  un*  tmpraaaion  au  moment  qui  iambi*  opportun  at  radlmarrar  *n»lqu«nc*. 

-  dlclonchar  un*  tmpraaaion  automatiqua  A  das  inatantu  prlcia  conalgnla  dan*  une  tabl*  initialial* 
par  l'oplrataur  au  dlbut  du  travail. 


3.4 .  DESCRIPTION  DU  MATERIEL  C0MP08AOT  LA  BALE  DE  VALIDATION  PE  LOGICIEL 

La  configurat ion  matlrialle  a  pour  objet  da  i 

-  tranamattra  au  calculateur-avion  lit  informationa  iout  laa  format  prlvuaa  an  foncf ionnamant  oplration* 
nal. 

-  parmattra  las  acticna-oplrataure  almulant  laa  aotiona-pilotea. 

-  parmattra  la  visualisation  at  1' impraetlon  da  paramltrea  at  rlaultata. 

-  parmattra  la  mis*  an  oauvra  da  la  BVL. 

On  pant  dlatinguar  quatrc  partiaa  l 

a)  la  oaloulataur  da  bale,  qui  aat  un  oaloulataur  EMD  atria  84,  Iquipl  da  64  K  mote  da  mtmoira,  at  qul 

rltlieo  toui  laa  traitemante  da  simulation  non  affeetula  au  centra  da  calcul  (glnlration  du  flahlar 

banda  magnCtiqua) . 

b)  laa  plriphlriquaa  da  miaa  an  oauvra  da  la  baia  i 

-  una  imprimanta  avao  antrla/aortla  aur  caaaatta  pamattant  la  fonct ionnamant  hora  tarapa  rial,  an 
particuliar  laa  Inltialiaatlomi  ,  ainal  qua  la  ohargamant  da  programma. 

-  un  lactaur  da  ruban  parforl  parmattant  la  ohargamant  daa  program., aa  at  da  la  mtmoito  da  l'loran. 

-  una  faea-avant  parmattant  la  almulation  d'ltata  at  la  dlpantiaga  da  la  bala. 

c)  lea  plriphlriquaa  da  almulation  da  l'environnomant-avion  • 

-  un  anaamlila  Reran  graphlqua  avao  clavlar  alphanumlriqua,  clavlar-fonction  at  crayon  da  dlalgnation 
da  l'loran.  Cat  aneanfcla  pavmat  la  almulation  daa  difi'lranta  poataa  da  commandaa,  daa  vlaaura,  daa 
diacrona  at  pannaa,  laa  affichagea  daa  paramltraa,  at  la  fonctionnamant  an  modua  ralantl  ou  paa  I 

paa. 

-  un  dlroulaur  da  bunda  magniitlquo  parmattant  Sexploitation  aiquantlalla  du  fichiar  da  paramltraa 
gintrl  an  centra  da  calcul. 

-  un  itvnche  aux  axaa  pa.mattant  la  glnlration  da  trajactoiraa. 

d)  lea  plriphlriquaa  da  liaiuon  nvoc  la  oalculataut  central  ambarqul. 

-  un  a.tiemble  couplcur  multimode  du  but  atandard  (CMBS)  ot  digibua  qui  aart  I  l'lohanga  daa  dunntiai 
numlriquaa,  at  qui  parmat  la  almulation  da  toua  laa  ebonnda  au  digibua  done  la  calculateur  avion 
eat  glriint, 

•  una  unit!  da  codaga  dtcodnga  qui  almule  let  aynohroa,  laa  tanaiona  ainal  qua  laa  ditcreta  "fil  A 
fil". 

-  un  enaambla  da  misu  en  oauvra  du  oalculataur  avion,  eomprenant  un  bua  paralllla  !6  bite  at  una 
ligna  slrie  de  prooldura  at  da  maintenanoa. 

-  un  couplaur  pour  almulation  d' informationa  aur  bua  ARINC. 


Ramarquaa  t 

On  pout  ajouter  d'autraa  rouplcura  da  liaiaona  pour  aimulation*  dr  liaiaona  partlcul iAraa  A  un  typa 
d'a\ if.  , 

L' imprimanta  aart  auaal  it  1 ' imprstaion  daa  paramAtrea, 

I.e  dlroulaur  da  banda  magnltiqua  aart  auaai  au  ohargamant  dot  programme  dana  la  HVL  at  dana  la 
calculateur-avion. 


it 


UR. 


INTERFACE 


CALCULATED 
DE  BAIE 


AFIORAT 


Fhoto»tyUk!Uv{«r 


i* 


BoTtiar 


nit*  da  codag 

ddcodaga 


CALCULATEUR 

PRINCIPAL 


1.5.  DESCRIPTION  DES  LOOICIELS  NECEBSAIREN  AO  PONCTIOHNEMENT  DE  LA  BAIR  DE  VALIDATION  DE  LOOICIEL 


La  gdndration  du  fiahlar  banda  magndtiqua  aa  fait  an  daux  partlaa  i  tout  d'abord  gdndration  da  para- 
mdtraa  primairaa,  puii  traitanwnt  compldmcntaira  at  miia  au  format  pour  gdndrar  laa  "banda*  da  vola" 

La  glndratlon  daa  parambtra*  primairaa  aa  fait  da  daux  manllraa  i  an  cantra  da  calcul  ou  aur  BVL. 

-  an  aantra  da  calcul  ,  l'utlliaataur  ddfinit  una  trajactoira  par  puinta  da  coneignaa,  an  donnant 
la  vactaur  vitaaaa  pour  chaqua  point,  at  un  ddfiniaaant  la*  condition!  initial**  du  vol,  tall** 
qua  i  hautaur  du  aol,  latituda,  longituda  at  wandar  angle  initlaux,  compoaantaa  du  vant,  ddeli- 
naiaon  magndtiqua,  poaitiou  at  vactaur  vitaaaa  daa  hoatilaa,  coordonndaa  at  typ*  da  but..  Cat 
donndaa  initial**  aont  atockda*  an  tlta  du  fiohiar  band*  magndtiqua. 

La  trajactoira  da  conaigno  aat  anauita  filtrda  da  roanitr*  k  n*  pa*  affaotar  aa  forma  gdndral*. 

En  tenant  compta  d'un  moddla  da  la  tart*  at  d'un  modlle  d'atmoaphira,  aont  gdndrda  alor*  laa  para" 
mdtraa  primairaa  dont  laa  principaux  aont  i  la  poaition  couranta  da  l'avion,  la  vitaaaa  da  l'avion 
an  axaa  gdographiquai,  laa  ainu*  at  coainu*  daa  roulia,  tangago  at  cap  vrai,  1 1  incidence,  l'arraur 
da  rout*,  laa  valour*  accdldromdtriqua*. . .  Ca  logic!*!  aat  dcrit  en  FORTRAN  aur  IBM  370. 
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-  iur  BVL,  la  trajactoire  ast  ginirka  an  tampa  r(el.  Cette  mkthode  priaenta  par  rapport  ft  la  prtct- 
denta  lea  avantagaa  suivants  : 

.  sSlaction/diaklection  da a  buts  au  choix, 

•  riponaa  k  una  loi  qualro'dqua  da  pilotage, 

.  possibility  par  ralaotura  da  la  banda  an  ralanti  da  vlrifiar  inatantandnant  la  qualitl  du  vol , 

Ca  logicial  gintra  laa  nfimaa  paraoltrca  qua  la  prkokdent  .  II  nkcaaaita  as  outre  dea  taodulaa  da 
gaation  da  l'iaprimsnta,  da  l'fcran  graph! qua,  dea  claviers,  du  manehs-2-axaa  at  du  ddroulaur  da 
banda  magnktiqua.  II  aat  dorit  partiallamant  an  LTR,  l'autra  partia  dtant  an  aaaanblaur. 

La  gdndration  daa  paramktraa  aacondairaa  aat  rdaliede  an  centra  da  calcul  an  raprannant  la  f iehiar 
priwaira  erdd  par  una  daa  mdthodaa  ddcritaa  cl-daaaua.  Ca  logicial  aat  diraetsment  lid  au  type  da 
1' avion. 

On  coopltta  par  laa  pvinaipaux  paramktraa  auivanta  i 

-  cantrala  adro  t  tampdraturaa  atatiqua  at  totala,  Mach,  vitaaaa  convantionnalla,  danaitd  da  l'air, 
altitudaa  baromdtriquaa  at  rdalla... 

-  cantrala  k  inertia  i  rayona  da  courbura  locaux  aat  at  nord,  inerdmenta  an  latitude  at  longitude, 

variation!  du  vandar  angle,  vitaaaaa  at  accdldrationa  an  axaa  plateforme,  dcart  da  routa,., 

-  ayattma  radar  tiita,  giaamant,  dldvation  da  la  cihla,  vitaaaaa  ralativaa,  diatanoa  cibla,  rota¬ 

tion!  an  axaa  avion  da  la  droita  avion-eible. . . 

Ca  logicial  aat  dcrit  an  FORTRAN  aur  IBM  370,  Sa  aortia  aat  la  banda  da  vol  exploitd  aur  BVL  lore  da 
la  phaaa  da  taata  dynamiquas.  II  parmat  la  gdndration  da  paramktraa  cohdrante. 

b) Logicial  da  almulatlon  at  da  teat  l 

II  aat  adpard  an  troia  groupaa  t 

-  la  logicial  da  baaa 

-  la  logicial  da  bale 

-  la  logicial  do  simulation 

La  logicial  da  baaa  t  il  a'agit  lk  d'un  logicial  inddpendant  da  la  BVL,  servant  I  d'autras  applica¬ 
tions  aur  d'autras  matdrial.  11  aa  compost  da  dtux  partita  t 

-  la  systkme  qui  aat  la  programme  da  mist  an  oeuvre  daa  bale*  at  calculateur  da  la  adria  BA ,  11  aa- 
aura  trois  fonction*  i 

,  fonction  "pupitra"  da  gaation  da  la  face  avant  da  la  bale. 

.  fonction  ayatfema  d'anchatnement  dea  travaux  (an  convaraationnal  ou  par  lots). 

,  fonction  aurparvialon  d' sntrdsi/sortios  pour  les  programmes  a'exkcutant  dans  la  calculataur-avion 
ou  dana  la  calculatur  da  bale, 

-  le  raonitaur  comps  rdul,  qui  ast  un  produit  compatible  LTR  at  Assamblaur  BA,  Ses  fonctions  sont  i 

■  la  gaation  das  ttchas 

.  la  gaation  daa  dvdnaments 

,  la  gaation  das  rasaourcas 

,  la  gaation  daa  entrdes/aortiea 

,  la  partaga  du  tempa 

C'aat  la  monitaur  temps  rdel  qui  contrile  tout  la  logicial  BVL.  II  ast  k  notar  qua  c'ast  un  moniteur 
idontiqua  qui  supervise  la  logicial  du  calculataur-avion.  II  eat  paramktrd  da  tuanilre  k  adapter  la 
volume  da  ses  tables  da  cheque  application. 

L'anaanhla  du  logicial  da  base  da  la  BVL  raprdsanta  un  volums  mdmoira  da  12  K  mots  da  16  bits. 
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La  logicial  da  bait  i  c'aat  la  logicial  aplclflqua  BVL  qul  ait  indlpandant  da  1' application  au 
nivaau  du  coda.  II  I’agit  dai  prograsanaa  auivanta  : 

.  gaition  daa  intarruptiona  i  caa  moduli!  ont  pour  principal!*  fonctiona  i 

-  d'acquittar  laa  damandaa  dec  divaxa  ptriphtriquaa  (banda  magnltlqua,  couplaur  multinod*  da  bua 
atandard,  4  c  ran  eathodiqua,  tllltyp*) ,  all  in  d'ilira  laa  divaraaa  tlchea  raquiaaa. 

-  da  cadancar  I  l'aida  d'una  horloga  progrannabla  laa  travaux  cyoliquaa. 

-  glrar  laa  arraui'a  da  nivaau  llavi  i  arraura  da  paritl,  dlbordamant  (lottant . . . 

.  gaition  da  la  band*  nagnltiqua  t  all*  rtaliaa  1 '  acq-iialtion  daa  divat'jB  paraalrraa  parmattant  da 
aioular  un  vol,  at  da  rlaliaar  l’anragiatramant  daa  valaura  lor*  da  la  gintretlon  da  trajactolra* 
aynthitiqua  "au  nancha". 

.  gaition  daa  tohangaa  l  il  a'agit  du  traitamant  daa  antrlaa/aortia*  via-k-vi*  du  calmll* taur-avion , 
c'aat-k-dir*  l'lmiaaion/rt caption  daa  diacrata  "fil  k  fil",  daa  codagaa  at  dkeodagaa,  at  du  dia- 
logua  aur  1*  digibut  via  la  CMBS • 

.  gaation  da  l'lcran  graphiqua  :  alia  eomprand  l'anaambla  daa  program**  rkaliaant  la  dlcodag*  daa 
comaandai  olaviar  ou  photoatyla  at  1*  branehamant  du  traitamant  corraapondant ,  at  l'affir.hag*  k 
l'lcran  daa  diffirantaa  inagaa  a vac  laur  rafratchlaaamant  cycliqu*. 

.  gaation  tllltyp*  i  all*  parmat  1*  dump  aur  tllltyp*  d'un  anaanbla  da  variable*  luaa  an  mlmolr*  du 
calculataur-avion,  dlliniaa  par  laur*  labala  rangla  an  tabla  ,  avac  format,  mil*  an  page.  MSB. . . 

Ella  rtaliaa  l'impraaaion  automatiqua  ou  intaractiva  da  caa  paramktraa. 

L'anaambla  du  logicial  da  baia  raprlaanta  un  voluma  mlmolra  da  10  K  mot*  da  16  bit*. 

La  logicial  da  aimulation  t  il  eomprand  d'uno  part  1*  logicial  imaga  da  l'lcran,  d'autra  part,  la 
logiclal-calculataur  da  baia. 

,  1*  logicial  imaga  da  l'lcran  conatitu*  an  fait  la  parti*  graphiqua  da  la  aimulation.  11  a'agit  daa 
raprlaantationa  daa  difflranta  Iquipamanta  dont  on  ilmula  l'intarfaca,  da*  affiohagea  da  paramk- 
traa  at  da  pannaa, 

C*  logicial  conatitua  par  aactaura  la  olmoira  da  l'loran,  at  raprlaanta  anvlron  10  K  mot*  da  voluma 
mlmolra.  Il  aat  lerit  dana  un  langaga  intarprltutif  an  oantr*  da  caloul. 

.  la  logicial  d*  aimulation  eomprand  an  fait  la  logiqua  da  traitamant  da  touta*  laa  information* 
an  ontrla/aortia  du  calaulataur-avion.  A  cala,  il  conviant  d'ajoutar  toutaa  la*  logiqua*  nlcaaaairas 
pour  1 'llaboration  daa  divaraaa  information*.  Four  cartaimia  aimulation*,  ca  logicial  attaint  30  K 


mota. 
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aiAPITRE  IV 


CONCLUSIONS  ET  PERSPECTIVES 


La  baia  da  validation  du  logicial  a  montrl  qu'll  aat  poaaibla,  dana  la  domaina  avioniqua,  da  validar  un  logi- 
cial  tempi  riel  sn  dahora  du  eontaxta  oplrationnal  rial. 

Pour  atnlliorar  la  productivitl  da  la  BVL,  il  aat  poaaibla  da  tenter  una  automatiaation  da  la  proddura  da 
validation  par  oomparaiaon  daa  rlaultate  I  daa  valaura  prl-anragia trite .  Catta  option  aat  difficile  t  ratanir 
par  la  manque  da  aouplaaaa  qui  la  carautlriaa. 

La  probltma  fondamantal  da  qualitl  rlside  dana  l'inadlquation  daa  anlcificatlona  da  logicial  avac  la  probltaM 
1  rlaoudra  at  lea  modification!  du  logicial  qui  an  dlcoulant.  C'aat  done  dana  la  domaina  da  l'ltobllaaamant 
daa  eplcificiitiona  qua  dolvant  aa  porter  laa  afforta. 
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ABSTRACT 

This  paper  addresses  the  modeling,  simulation,  and  performance  predictions  used  in 
determining  aircraft  avionics  and  transfer-aliqnment  requirements  for  a  generic  airaraft 
that  would  launch  cruise  missiles  over  watar,  a  aonsideraoXe  distance  from  a  first 
TERCOM  update  area.  Such  would  be  the  case  for  an  undefended  wide-body  aircraft  that  must 
remain  far  away  from  an  opponent's  air  defense  system.  This  long  standoff  range  presents 
some  unique  requirements  that  are  not  present  in  a  mission  where  cruise  missiles  are 
launched  "close"  to  the  first  fix  point,  as  from  a  penetrating  bomber.  The  methodology 
used  and  system  requirements  results  are  described. 


1 .  INTRODUCTION 

During  the  past  year,  the  Air  Force  haB  been  considering  aeveral  existing  U.S.  air¬ 
craft  aa  posnible  cruise-missile  (CM)  carriers.  These  aircraft  range  from  small  military 
transport  aircraft  to  largo  wide-body  commeroial  aircraft. (D  This  paper  describes  the 
methodology  and  results  of  a  parametric  study  conducted  to  determine  tho  navigation  re¬ 
quirements  for  such  airaraft. 

Section  2  of  this  paper  desaribes  the  methodology  used  in  allocating  the  allowable 
navigation  errors  between  the  CM  guidance  system  and  the  cruise-missile-oarrier-airoraft 
(CMCA)  avionios  system.  Prom  this  baseline  error  alloaation,  avionics  and  transfer- 
alignment  tradeoff  studies  were  conducted.  These  tradeoff  studies  are  described  in  Sec¬ 
tions  3  and  4,  respectively.  In  Section  5,  a  total  weapon-system  evaluation  from  air¬ 
craft  takeoff  to  cm  impaat  is  presented  which  validates  the  error  allocation  of  Section  2, 

2.  METHODOLOGY  FOR  BASELINE  SYSTEM  ERROR  ALLOCATION 

To  initiate  the  CMCA  avionios  tradeoff  portion  of  the  study,  it  was  necessary  to 
define  a  baseline  mission  for  both  the  CMCA  and  the  CM,  and  to  allocate  the  errors  be¬ 
tween  eaoh  navigation  system  to  meet  the  total  required  accuracy  at  the  first  TERCOM  fix 
area.  The  baseline  mission  is  summarized  in  Figure  1. 


•  BASS  UN  I  SUMMARY  -  AIR  IT  ART/ AIR  ALIUN  OP  CMCA  INI 

-  CMCA  PAST  REACTION  TAKEOFF  FROM  CONUS 

-  0,1-houi  DEAD  RECKONING  TO  FIRST  RADAR  FIX 

-  S  EQUALLY  SPACED  (AT  -  11  mini  OUTSOUND  RADAR  FIXES  HOOD  II.  CIPI 

-  DOPPLER  AIDINC  OVER  LANS,  UNAIDED  INERTIAL  OYER  WATER 

-  1  hour  li  mit,  RIPORI  LAUNCH,  CM  IN*  ACTIVATED 

-  0.1  hour  IIPORI  LAUNCH,  l-TURN  TRANSFER  ALIONMINT  MANEUVER 

-  CM  LAUNCH  •-  hum  TO  _  hour!  AFTER  LAST  OUTBOUND  FIX 

-  CM  PI.IOHT  (»  _  nml)  TO  LANDFALL  T I  ROOM  MAP 

-  CM  UPDATES  VIA  ENROUTS  MAPS  TO  TARQET 


Figure  1.  Baseline  mission  evaluation. 
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The  mission  begina  with  t  fast-reaction  takeoff  from  the  U.S.  with  the  CMCA  inertial- 
navigation  system  !INS)  dormant  and  unheated  at  takeoff.  During  the  next  30  minutes,  the 
attitude  heading  and  reference  system  and  a  Doppler  radar  are  used  to  dead-reckon  to  the 
nominal  site  of  the  first  radar  position  fix  while  the  CMCA  INS  is  being  powered  up  and 
thermally  stabilised.  Near  that  first  radar  fix,  the  CMCA  INS  is  initialized  from  the 
dead-raokoning  system  and  then  begins  navigating  after  the  fix  has  bean  made.  Nominally, 
a  total  of  eight  equally  spaced  radar  fixas  are  made  during  the  overland  portion  of  the 
outbound  flight  so  that  the  CMCA  INS  ia  aatisfaotorily  aligned  prior  to  beginning  ita 
long  overwater  flight  to  the  CM  launch  area. 

During  overwatar  flight,  the  CM  XNSs  are  powered  up  45  minutea  before  transfer 
alignment  and  calibration  of  the  CM  INSs  relative  to  the  CMCA  INS  are  begun.  The  tranafer- 
alignment-, /calibration  sequanae  ia  performed  within  a  30-minute  period  prior  to  launoh  of 
the  first  missile.  The  assumption  is  that  only  one  horizontal  CMCA  maneuver  will  be  used 
during  this  30-minute  period  to  aid  the  alignment  filter.  Following  completion  of 
transfer-alignment  and  calibration,  the  CM  is  launched  whim  it  ia  still  a  considerable 
distance  from  the  first  TERCOM  fix  point.  The  CM,  immediately  after  launoh,  descends  to 
a  law  altitude  and  executes  a  maneuver  to  bring  it  to  its  proper  ooureei  then  it  proceeds 
to  navigate  to  the  first  landfall  map. 

The  calibration  of  the  CM  guidanae  set  is  a  particularly  important  aspect  of  the 
transfer-alignment  mechanization.  Figure  2  lists  the  gyro  and  accelerometer  performance 
parameters  for  the  CM  guidance  set  after  a  2-1/2-year  dormancy  period.'2)  Even  if  the 
CM  guidance  system  ware  provided  with  perfect  initial  conditions  by  the  CMCA  INS,  theae 
performance  parameters  would  reault  both  in  a  system  error  growth  rate  on  the  order  of 
16  nmi/h  and  in  a  totally  unacceptable  position  error  at  the  nominal  firat-fix  point. 

(A  0.01-dey/h  gyro  drift  resulta  in  about  a  1.0-nmi/h  error  growth  rate.)  Consequently, 
the  methodology  of  the  study  was  to  first  evaluate  how  well  transfer  alignment  and  cal¬ 
ibration  might  be  performed;  then  to  allocate  the  errors  between  CMCA  avionics  and  trans¬ 
fer  alignment;  and  finally  to  perform  detailed  etudiee  within  each  allocation  to  deter¬ 
mine  if  the  allocation*  could  be  met. 

The  method  of  assessing  the  possible  aocuracy  from  transfer  alignment  is  to  perform 
a  covariance  analysis  baaed  on  a  complete  40-state  model  of  the  CM  navigation-system 
errors,  assuming  an  error-free  CMCA  navigation  system.  Position  difference*  between  the 
two  systems  are  compared  and  prooeosed  in  an  optimal  f.lter  to  estimate  the  CM  INS  param¬ 
eters.  A  full  40-state  optimal  filter  leads  to  optimistic  resulta  since,  in  practice, 
only  about  10  important  error  states  would  be  implemented  in  the  CM  computer.  Conse¬ 
quently,  a  "oonsider-variable"  approach  is  used  in  the  analysis  which  allows  a  realistic 
estimate  of  how  a  reduced-order  filter  might  Derform;  this  approach  alleviates  the  need 
to  actually  design  a  reduced-order  filter . '3, 4 , 5)  pigure  3  illustrates  the  oonsider- 
variable  appraaah. 
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Figure  2.  Inertial  instrument  parameters. 
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Figure  3.  Consider-variable 

covariance  analysis. 


This  tochnique  was  applied  to  the  transfer-alignment  problem.  Figure  4  illustrates 
the  results  of  transfer  alignment  and  calibration  performed  relative  to  tha  assumed- 
perfect  CMCA  inertial  system  while  the  aircraft  was  performing  a  horizontal  S-turn  maneu¬ 
ver  during  the  transfer-alignment  period.  Cases  2,  3,  and  4  correspond  to  different 
measurement  noises  I  ri  the  posi  lion -match  filter  used  for  transfer  alignment  between  the 
INSs.  The  measurement  noise  would  be  due  to  local  vibrations,  bonding,  and  flexure  be¬ 
tween  the  INS  locations.  Case  3,  corresponding  to  a  noise  of  1-ft  rms,  would  probably 


Reference  6  contains  a  typical  covariance-analysis  program. 
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exceed  the  .levele  to  be  expected  in  any  of  the  aircraft  conaidered.  Consequently,  Casa  3, 
a  CM  navigation  performance  of  1.0  nmi/h  (CEP)  relative  to  the  CMCA  INS,  was  chosen  as  the 
baseline  performance  that  should  be  established  as  a  goal  for  transfer  alignment  and 
calibration  of  the  CM  guidance  set. 


Section  4  will  aonsider  the  various  aspects  of  transfer  alignment  and  calibration 
in  detai  1  in  an  atte-  it  to  meat  the  goal  of  a  calibrated  CM  INS  whose  errors  grow  at  a 
rate  on  the  order  of  1  nmi/h  with  respect  to  the  CMCA  INS.  Figure  4  also  illustrates 
that  a  hey  parameter  is  the  azimuth  gyro  bias  term  that  exists  after  transfer  alignment 
and  calibration  have  been  completed.  Case  2  was  rerun  with  a  perfect  azimuth  gyro,  and 
the  differences  in  performance  are  quite  noticeable.  In  fabt,  as  illustrated  in  Figure  5, 
a  significant  error  growth  rate  appears  due  to  the  azimuth  gyro  alone,  if  the  gyro  is 
uncalibrated.  Consequently,  for  long-range  air-to-ground  weapons  using  this  guidanoe 
system,  adequate  calibration  of  the  azimuth  gyro  is  required  if  the  1-nmi/h  (CEP)  rela¬ 
tive  error  growth  rate  is  to  be  met. 


u  ,10  " . ~ . T «3 

n  ANC1 1 1  mil 


Figure  4.  Impact  of  transfer  alignment/ 
calibration  on  missile 
performance. 


Figure  5.  Response  to  azimuth-gvro  bias 

of  0.1  deg/h  (lc)  flying  north¬ 
west  great  oirale  at  600  ft/s 
constant  velocity. 


Given  the  requirements  on  navigation  accuracy  (CEPlf)  at  the  first  TERCQM  map,  and 
using  the  expected  CM  INS  relative  navigation-error-rate  performance  (CEPRcm)  of  1  nmi/h 
and  the  time  the  CM  must  fly  to  the  first  map,  it  is  then  a  simple  matter  of  algebra  to 
determine  an  approximate  expression  for  the  required  CMCA  navigational  accuracy.  Equa¬ 
tion  1  illustrates  the  mathematics. 
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CEP 


LF 


CEPRcm 


cepkcmca 


required  CEP  (nmi)  at  first  TERCOM  fix  after  CM  launch 

relative  error  growth  rata  of  CM  INS  (nominally  1  nmi/h) 

time  at  firsc  TERCOM  fix  (h) 

time  of  CM  launch  (h) 

error  growth  rate  of  CMCA  INS  in  nmi/h 


t0F  “  time  of  last  position  update  of  CMCA  INS  (position  update  is  assumed 

perfeat)(  tL  -  top  is  then  the  overwatar  lime  of  the  CMCA  during  which 
there  are  no  updates 

From  this  simple  expression,  the  maximum  allowable  range  of  the  CM  from  launch  to 
landfall  fix  can  be  traded  off  against  CMCA  INS  quality  for  various  ovarwatnr  CMCA  flight 
times  (i.e,,  time  since  last  CMCA  position  f ix) i  soe  Figure  6.  For  the  purposes  of  this 
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paper,  a  nominal  0,5-nmi/h  (cep)  has  been  selected  for  the  CNCA  navigation  system.  This 
performance  allows  several  missile  standoff  ranges  as  a  function  of  tho  overwater  flight 
times.  In  Section  3,  the  avionics  requirements  to  achieve  that  goal  are  presented . 


It  should  be  noted  that  thin 
study  addressed  only  the  position 
error  required  to  cross  the  first 
TERCOM  map.  No  requirements  were 
studied  for  acceptable  downrange  or 
orossrange  velocity  errors,  azimuth 
errors,  etc.,  at  the  first  map,  the 
assumption  being  that  an  acceptable 
fix  could  be  made  if  the  CM  over¬ 
flew  the  map. 

3.  METHODOLOGY  OP  CMCA  AVIONICS 
TRADEOFFS 

To  eelect  a  set  of  CMCA  avi¬ 
onic*  meeting  the  baseline  error 
allocation  of  0.5  nmi/h  (CEP)  after 
the  last  CMCA  outbound  fix,  a 
consider-variable  approach  was  again 
used.  A  12-atata  subotimal  filter 
consisting  of  north  and  east  posi¬ 
tion  and  veloaity  errors,  three  INS 
attitude  errors,  three  gyro  biases, 
and  two  Doppler  errors  was  used 
during  the  outbound  CMCA  flight  to 
perform  CMCA  in-flight  alignment  and 
calibration  after  the  cold  start  of 
the  CMCA  INS. 


OIVIN. 

I.  CHOI  AoaNID.CALIaWATtD  WIIATIVI  ID  CMCA  WITH  TYPICAL. 
MITIft  TO  WFILUT  IM  MlMl/h  AtlATIVI  KMOHMAUCI 

I,  lAMOIAll  MA'W'DTHOf_i.mi 


Figure  6. 


CM  range  versus  CMCA  calibrated 
INF  quality  for  overwater  flight 
times  from  last  CMCA  outbound  fix. 


Using  the  various  avionics 
suites  for  the  overland  outbound 
CMCA  flight,  the  resultant  error 
propagation  tor  three  generic  INSs 
has  been  plotted  in  Figures  7  and  6. 

It  should  be  noted  that  for  the  cases 
employing  Doppler  aiding,  Doppler 

aiding  is  shut  off  after  the  last  outbound  fix  so  that  for  all  cases  the  INS  operates  in 
the  pure  inertial  mode  (with  the  exception  of  altimeter  aiding)  during  the  overwatar  flight. 
This  avoids  having  to  make  modeling  assumptions  about  ocean  currents.  The  oaBes  with 
Doppler  aiding  refer  to  the  use  of  Doppler  aiding  up  to  and  during  the  position-fixing 
portion  of  the  baseline  mission. 


Figure  7.  Impact  of  performance  to 
avionics  using  baseline 
fixes  (8  fixes) . 


Figure  8.  Impact  of  avionics  on 
baseline  mission. 


The  results  presented  point  to  an  obvious  conclusion  that  the  CMCA  performance 
after  the  last  outbound  fix  is  practically  insensitive  to  improvements  in  the  position¬ 
fixing  radar  and  Doppler  aiding  between  fixes  for  tho  baseline  mission.  Thi«  insensi¬ 
tivity  is  due  to  the  fact  that  even  with  a  moderately  accurate  prisition-f ixing  radar 
(1,000-ft  CEP),  eight  fixes  are  enough  to  estimato  the  alignment  of  the  platform  and  to 
trim  the  sehsor  biases  to  the  levels  limited  by  random  drifts  and  nonobservability. 
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Figures  9  aftd  10  show  the  time  histories  for  the  calibration  of  the  azimuth  error 
and  north  gyro  bias,  respectively,  during  the  outbound  CMCA  flight  using  the  0.5-nmi/h- 
CE?  navigator  and  no  Doppler  aiding.  These  plots  show  that  using  a  higher  accuracy  radar 
allows  faster  calibration  and  alignment  of  the  platform.  However,  given  a  total  of  eight 
outbound  fixes,  the  end  result  remains  the  same. 


/ 

Figure  9.  CMCA  azimuth  error  oali-  Figure  10.  CMCA  north-gyro  bias 

bration  (0.5-nmi/h  oallbration  (0.5-nmi/h 

system) .  Mystem) . 

Figure  11  shows  the  impact  of  the  position-fixing  radar  aaauraoy  on  CMCA  perform¬ 
ance  when  the  number  of  equally  spaced  outbound  radar  fixes  is  reduced.  The  figure 
charts  the  CMCA  CEP  8  .hours  after  the  last  outbound  fix  for  the  generic  0. 5-nmi/h-CEP 
navigator.  Figure  12/is  a  time  history  of  error  propagation  when  a  2,000-ft-CEP  radar 
is  used  for  outbound  position  fixing.  Mote  that  in  both  Figures  11  and  12,  no  Doppler 
biding  ia  employed  between  position  fixes.  Both  figures  illustrate  the  need  for  more 
accurate  position-fixing  radars  If  the  time  and  number  of  outbound  fixes  is  reduced  from 
the  baseline,  it  dbes  appear,  however,  that  as  long  as  six  outbound  fixes  arc  available 
over  a  i-.l/2-hour  period,  adequate  CMCA  INS  alignment  can  be  achieved  using  a  2,000-ft- 
CEP  radar  alone.  / 

! 


Figure  11.  Impact  of  reducing  the 

number  of  equally  spuoed 
outbound  position  fixes. 


Figure  12.  Impact  of  reducing  tho 

number  of  equally  spaced 
outbound  position  fixes, 


Figure  XI  also  shows  that  four  outbound  fixes  using  a  1,000-  to  2,000-ft-CEP  radar 
are  not  adequate  tu  align  the  0.5-nmi/h  INS  to  the  0.5-nmi/h  (CEP)  level  using  only  radar 
fixes.  Figure  13  shows  that  the  addition  of  Doppler  aiding  between  four  outbound  2,000- 
ft  radar  fixes  permits  further  calibration  and  alignment  of  the  CMCA  INS  down  to  the  0.5- 
nmi/h  (CEP)  Jovel.  What  Doppler  aiding  provides  is  best  illustrated  in  Figure  14,  which 
ie  a  plot  of  azimuth  misalignment  estimation  during  the  outbound  fixes.  Doppler  aiding 
enables  faster  azimuth  estimation,  so  that  by  the  fourth  fix,  the  steady-state  estimation 
level  has  1  een  reached)  whereas  without  Doppler  aiding,  two  more  fixes  are  required. 

Similar  results  were  observed  using  a  better  quality  0.1-nmi/h  (CEP)  navigator. 

The  impact  of  reducing  the  time  and  number  of  equally  spaced  outbound  fixes  for  this 
navigator  is  shown  in  Figure  15.  Again,  the  importance  of  Doppler  aiding  when  the  num¬ 
ber  of  fixes  ie  reduced  ic  clearly  shown.  It  io  noteworthy,  however,  that  by  using  the 


higher  quality  navigator,  no  Doppler  aiding,  and  a  1,090-ft-CEP  radar,  an  acceptable 
error  growth  rate  of  0.5-nmi/h  (CEP)  can  still  be  achievod  with  four  fixes.  Thus,  hiqh- 
er  quality  navigators  provide  the  flexibility  of  reducing  TERCOM  map  widths  or,  as  an 
alternative,  may  provide  for  reducing  the  number  of  outbound  radar  fixes,  particularly 
with  Doppler  aiding  ir.  use. 

Figure  l(i  illustrates  the  required  TERCOM  landfall  map  widths  versus  CMCA  INS 
quality.  If  the  baseline  map  width  is  reduced  by  a  factor  of  2,  'hen  the  requirement  on 
the  CMCA  INS  is  on  the  order  of  0.2  to  0.3  nmi/h  (CEP).  There  is  an  advantage  to  using 
smaller  map  widths,  in  that  onboard  storage  and  computation  is  minimised  for  the  CM,  and 
it  is  also  likely  that  many  more  suitable  map  areas  with  the  appropriate  terrain  statis¬ 
tics  over  the  entire  TERCOM  map  would  be  available  for  use  in  fixing. 

For  the  baseline  CMCA  mission,  the  requirements  for  CMCA  avionics  can  easily  be 
met  by  state-of-the-art  INSs,  Doppler  radars,  and  position-fixing  radars.  Consequently, 
technology  issues  are  not  the  key  issues  in  selecting  the  CMCA  avionics  suite;  rather, 
the  key  issues  are  cost,  nuclear  hardness,  and  commonality  with  equipment  already  in  the 
inventory. 
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Figure  13*  impact  of  Doppler 
aiding  on  CMCA  IN3 
performance. 


(»IX  4)  (MM  kl  iriXII  (XIX 11  (MX  I: 


Figure  14.  CMCA  azimuth  misalignment 
calibration. 
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Figure  15.  Impact  on  ivionics  when  the 
number  of  outbound  fixes  is 
reduced. 


Figure  16.  Required  TERCOM  landfall 
map  widths  versus  CMCA 
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4.  TRANSFER  ALIGNMENT/CALIBRATION  ISSUES 


Transfer  alignment  was  addressed  using  a  10-state  suboptimal  position-matching 
filter.  The  states  were  two  horizontal  porition  errors,  two  horizontal  velocity  errors, 
three  attitude  errors,  and  three  gyro  drifts — all  relative  to  an  assumed-perfect  CMCA 
INS.  Some  of  the  effectB  studied  included  different  types  of  maneuvers  and  maneuver 
times  within  a  30-minute  transfer-alignment  period,  longer  alignment  times,  CM  heeding 
sensitivities,  and  in-air  gyrocompass ing. 

Figure  17  shows  the  subsequent  CEP  error  growth  rate  for  three  different  types  of 
maneuvers  occurring  in  the  transfer-alignment  period  of  30  minutas.  It  is  apparent  that 
for  a  1-nmi/h  relative  calibration  requirement  bind  for  the  imposed  constraints,  a  45- 
degree-heading  ohange  maneuver  is  unacceptable  for  aubsoquent  CM  flight  times  longer  than 
about  an  hour.  However,  Figure  IS  shows  that  if  the  45-degree-heiiJing  ohange  occurs  at 
the  beginning  of  the  alignment  period,  a  near-acceptable  error  growth  rate  is  achieved 
for  slightly  over  2  hours.  Figure  19  shows  the  results  for  longer  alignment  times  up  to 
60  minutes  using  a  single  S-turn.  Hers  it  is  noted  that  as  the  alignment  times  are  in¬ 
creased,  the  single  s-turn  results  in  significant  improvement  in  the  CEP. 

Figure  20  shows  the  results  for  the  case  of  a  single  S-turn  in  a  30-minute  tranafer- 
alignment  period  where  the  cm  subsequently  flies  straight  ahead  after  launch  (trajectory 
B) ,  and  for  the  aaae  where  the  CM  makes  a  turn  after  launch  and  then  fliee  straight  ahead 
(trajeotory  A).  The  difference  in  the  aubaequent  CEP  error  growth  rate  is  due  primarily 
to  the  sensitivity  of  the  inertial-syatem  error  growth  rate  to  the  final  trajeotory  head- 
ing..  Thii  ia  an  effect  commonly  seen  in  long-term  aircraft  inertial-navigation  problems 
and  it  is  an  important  effect  for  long-range  air-to-ground  misailea. 
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Figur  )  17.  CM  CEP  versus  time  (range) 
after  launch  for  a  45-deg 
heading  change,  single 
S-turn,  and  triple  S-turn 
alignment  maneuvers. 


Figure  13.  CM  CEP  versus  time  (range) 
for  60- ,  45-,  and  30-minute 
alignment  periods. 
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Figure  18.  CM  CEP  versus  time  (range) 
launch  for  45-deg  heading 
change  maneuvers  executed 
at  15  and  5  minutes  into  a 
30-minute  alignment  period. 
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Figure  20.  CEP  versus  time  (range) 
after  launch  for  CM 
trajectories  A  and  B. 
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The  use  of  either  single-position  or  two-position  in-air  gyrocompassing  for  extended 
periods  of  time  was  also  investigated.  Possible  benefits  of  in-air  gyrocompassing  are 
that  better  calibration  of  the  CM  guidance  set  may  be  achieved  and  that  the  potential 
exists  for  eliminating  maneuver  requirements.  Figure  21  shows  the  results  in  terms  of 
azimuth  misalignment  of  the  CM  guidance  set  for  the  single-position  and  two-position  in¬ 
air  gyrocompassing  cases,  ss  well  as  for  the  S-turn  transfer-alignment  maneuver  previously 
discussed.  The  azimuth  error  in  the  latter  case  is  significantly  lees  than  the  in-air 
gyrocompassing  cases.  Figure  22  shows  the  resultant  CEPs  for  all  three  cases.  Ths  S- 
turn  transfer-alignment  maneuver  is  clearly  superior  to  in-air  gyrocompassing  schemes. 


Figure  21.  Azimuth  misalignment 
calibration. 


Figure  22.  CM  error  only  after  launch 

for  various  in-air  alignment 
aahemee. 


Figure  23  presents  results  for  the  gyro-drift  estimation  for  the  three  in-air 
alignment  schemes.  Note  that  the  gyrocompass  oases  always  result  in  better  estimation 
of  the  gyro-drift  parameters.  A  logical  combination  of  the  approaches,  then,  would  be 
to  do  in-air  qyrocompassing  for  aa  long  as  posaible  during  the  overwater  portion  of  tho 
CMCA  flight,  and  then  to  do  a  maneuver  within  a  period  of  30  minutes  prior  to  lsunch  to 
bring  the  azimuth  error  down  to  acceptable  levels. 

In  summary,  various  options  are  available  for  uso  in  transfer  alignment  and  cali¬ 
bration  of  the  CM  guidance  set.  Many  of  these  options  appear  to  give  acceptable  CEP 
error  growth  rates  according  to  the  baseline  error  allocation.  Which  option  la  ohoeen 
would  appear  to  be  primarily  a  function  of  operational  constraints  such  as  the  power  and 
cooling  requirement!  of  the  CM  INS. 
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Figure  23.  CM  critical  parameter  estimation 

for  various  in-air  alignment  schemes. 
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5.  BASELINE-MISSION  EVALUATION 

The  previous  sections  have  described  the  tradeoffs  conducted  for  the  CMCA  avionics 
and  for  transfer  alignment  and  calibration.  The  intent  of  this  section  is  to  present 
some  overall  system-level  results,  including  both  transfer-alignment  and  avionics  errors. 

The  CM  flight  profile  that  was  used  in  this  study  is  shown  in  Figure  24.  An  8-turn 
transfer-alignment  maneuver  is  used  onboard  the  aircraft,  and  la  followed  by  launch  of 
the  CM.  The  CM  then  descends  to  low  level,  makes  a  90-degree  turn  and  flies  for  a  con¬ 
siderable  distance  until  Fix  41 r  it  subsequently  makes  five  more  fixes  on  its  oourse  in¬ 
to  the  target  area.  Each  of  the  fixes  updates  the  CM  guidance  system1 a  knowledge  of 
position,  velocity,  attitude  errors,  and  gyro-drift  errors.  Consequently,  the  required 
TEflCOM  map  widths  decrease  as  a  function  of  the  number  of  fixes.  The  smaller  map  widths 
allow  more  accuracy  at  each  fix,  until  at  Fix  #6  the  accuracy  at  the  fix  ie  actually 
much  better  than  tna  accuracy  an  target. 

Figure  2$  shows  the  nondimansional  total  CM  oroaeranga  error  after  launch  for 
launches  that  occur  at  two  different  times  after  the  last  CMCA  outbound  fix.  The  dotted 
lines  show  the  allowed  1-sigma  orossranga  error  at  eaoh  fix  location.  Note  that  the 
allowed  error  decreases  because  the  map  widths  deoreasa.  As  can  be  seen  from  thia  figure, 
the  error  eliooation  haa  resulted  both  in  acceptable  errors  at  each  fix  time  end  in  an 
acceptable  on-target  CEP.  The  final  CEP  ia  also  a  strong  function  of  how  far  the  cruise 
micella  must  fly  from  the  last  TERCOM  map  to  the  target. 
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Figure  24.  CM  flight  profile.  Figure  25.  CM  orossranga  error 

after  launch. 


6.  CONCLUDING  REMARK.! 

A  representative  CMCA/CM  weapon-system  mission  has  been  used  to  evaluate  the  system- 
level  error  allocation,  and  it  has  been  shown  that  a  CMCA  navigation  error  rate  of  0.5- 
nmi/h  (CEP),  or  less,  and  a  relative  CM  navigation  error  rate  of  1-nmi/h  (CEP),  or  lass, 
results  in  an  acceptable  high  probability  of  overflying  the  first  landfall  TERCOM  map, 
aa  well  as  the  maps  enroute  to  the  target.  The  key  issues  in  implementing  a  CMCA  navi¬ 
gation  and  guidance  system  do  not  appear  to  be  performance  issues  ainaa  the  requirements 
can  be  met  by  well-known  state-of-the-art  avionics  elements. 
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A  FLIQhT  SIMULATION  INVESTIGATION  ON  THE  FEASIBILITY  OF 
CURVED  APPROACHES  UNDER  MLS  GUIDANCE 
by 
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SUMMARY 

Thia  paper  deioribea  a  simulation  investigation  concerning  the  possibilities  of  executing  laterally  cur¬ 
ved  approaches  vith  a  vide  body  type  of  aircraft  in'a  MLS  environment*  The  approach  path  variables  veret 
final  approach  intercept  altitude  and  angle  of  the  turn*  An  earth  fixed  circular  segment  connected  the 
straight  preturn  segment  vith  the  final  segment*  A  flight  director  operating  in  the  ILS  tracking  mode,  sup¬ 
plied  vith  minor  modifications  in  the  roll  bar  drive,  has  been  used  as  the  primary  instrument  for  guidanoe. 
Additional  provisions  have  been  made  to  enable  the  pilot  to  monitor  the  approach.  A  total  number  of  about 
450  curved  approaches,  performed  by  three  pilots,  have  been  flovn  on  the  simulator  under  various  veather 
conditions* 

In  addition  to  tracking  data,  subjective  information  like  pilot  ratinge  and  comments  were  gathered*  It 
turned  out  that  curved  approaches,  vith  turn  angles  up  to  180°  can  be  carried  out  safely,  provided  that  the 
altitude  at  vhich  the  turn  is  completed  is  not  less  than  305  m  (1000  ft).  Speoial  provisions  are  needed  vith 
respect  to  the  flight  director  roll  bar  drive,  in  order  to  achieve  accurate  tracking  on  the  curved  segment 
in  strong  vind  conditions. 


LIST  OF  SYMBOLS  AND  ACRONYMS 

a  normal  acceleration 

n 

AVD  along  track  diotancet  distance-to-go  to 

the  approach  path  intersection  vith  runvay 
centreline,  meaeured  along  the  nominal  ap¬ 
proach  path  projection  on  the  horitontel 
plane 

a*gi  centre  of  gravity 

DME  Dietanoe  Measuring  Equipment 

F  turbulence  intsrmittmioy  i'aotor 

FAA  Federal  Aviation  Adminiitration 

HSI  Horizontal  Situation  Indicator 

ICAO  International  Civil  Aviation  Organization 
ILS  Inetrument  Landing  Uyatern 

IMC  Inetrument*  Meteorological  Conditione 

L  distance  between  approach  path  intersection 

vith  runvay  centreline  and  azimuth  antenna 
site 

mso  mean  aerodynamic  chord 

MIS  Miarovsva  Landing  System 

PR  pilot  effort  ratine 

PR  normalized  pilot  effort  rating 

r  radius  of  turn 

TCP  turn  completion  point 

TIP  turn  initiation  point 

V  airspeed 

VMC  Visual  Meteorological  Conditions 

v.  „  ,  indication  of  the  three  considered  veather 
*  conditions 

xft  x  co-ordinate  of  aircraft  position 

x  horizontal  distance  batvesn  the  approach 

g  path  interaeotion  vith  runvay  oentreline 

and  the  turn  completion  point 
x  average  value  of  a  particular  item  to  be 

rated 

yB  y  co-ordinate  of  aircraft  position 

zR  t  ao-ordinate  of  aircraft  position 

a  turn  angle  (positive  for  right-hand  turns) 

V0  nominal  angle  of  descent  of  the  approach  path 

c  vertical  angular  puth  error,  positive  if 

aircraft  above  glide  path 
n  croso  track  deviation 

0  elevation  angle  of  aircraft  position  with 

respoct  to  the  elevation  antenna  sitet  pitoh 
attitude 

5  vortical  path  deviation 

p  slant  range  between  DME  trancmitter  and 

aircraft 


o  lateral  angular  path  error,  positive  if  aircraft 
right  of  track 

□  standard  deviation  of  a  particular  item  to  bt 

rated 

t  time  constant 

<p  roll  angle 

<pQ  roll  angle  bias 

i|i  azimuth  angle  of  the  aircraft  position  vith 

respect  to  the  azimuth  antenna  site 


1  INTRODUCTION 

Due  to  the  narrow  ooversge  in  both  azimuth  and 
elevation,  the  present-day  Instrument  Landing  System 
(ILS)  can  only  provide  guidanoe  along  a  straight  line 
approach  path. 

When  the  Microwave  Landing  System  (MLS)  will  be 
put  into  Bsrvice  on  civil  airports  not  only  a  means  for 
more  precise  approach  guidance  becomes  available,  but 
moreover  MLS  yields  the  advantage  of  offering  more 
flexibility  in  adapting  the  shape  of  the  approach  path 
profile  to  the  local  ciroumatanoes  of  a  particular  air¬ 
port  Bite. 

Due  to  the  wide  coverage  in  both  azimuth  and  ele¬ 
vation  as  illustrated  in  figure  1,  MLS  yields  the  possi¬ 
bility  of  offering  guidance  along  aurved  or  segmented 
approach  paths. 

From  several  investigations  (e.g.  Duning,  K.E. , 

1973)  it  appears  thst  curved  approach  paths,  with  simul¬ 
taneous  vertioal  and  lateral  curvatures,  are  less  suit¬ 
able  for  application  in  civil  aviation. 

Sinoe  IFALPA  with  respeot  to  the  FAA  advanced  notice  of 
proposed  rule  making  (ANPRM  74-12)  rejsoted  approaoh 
procedures  below  1 500  ft,  which  require  rates  of  descent 
in  excess  of  1000  ft/min  or  multi  descents  paths,  only 
lateral  curvatures  will  be  considered. 

In  the  present  investigation  seven  laterally  seg¬ 
mented  approach  profiles  have  been  selected  vith  widely 
different  valueB  of  the  characteristic  profile  parameters 
in  order  to  include  a  wide  range  of  approaoh  paths  within 
coverage  of  the  MLS. 

The  aim  was  to  establish  limits  with  respect  to  the 
turn  angles  and  the  final  intercept  altitudes  for  a  slov- 
manoeuvering  type  of  aircraft. 
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2  APPROACH  PATH  PROFILE  GEOMETRY 

2. 1  General 

The  investigation  was  restricted  to  approach  paths  being  composed  of  three  segments:  a  straight  pre¬ 
turn  segment,  a  circular  segment  and  a  straight  final  segment,  whereas  the  angle  of  descent  is  constant 
along  the  entire  approach  path. 

A  sketch  of  the  basic  geometry  of  the  laterally  segmented  approach  paths  is  presented  in  figure  2,  as 
shown  the  projection  of  the  curved  segment  on  the  horizontal  plane  hae  been  chosen  circular. 

The  approach  path  is  characterized  by: 

-  the  length  of  the  final  segment  (xQ) 

-  the  turn  angle  (a) 

-  the  turn  radius  of  thu  curved  segment  (r) 

-  the  angle  of  descent  (y0) 

To  determine  the  aircraft's  position  relative  to  the  nominal  path  the  "along  track  distance"  (ATD)  has 
been  introduced.  The  ATD  is  representing  the  distance-to-go,  measured  along  the  projected  approach  path  on 
the  horizontal  plane,  as  illustrated  in  figure  2. 

The  position  of  the  aircraft  with  respeot  to  the  approach  path  can  be  expressed  int 

-  along  the  track  diatanoe  (ATD), 

-  orosa  track  deviation  (n ) ,  being  the  horizontal  distance  from  the  nominal  path,  and 

-  vertical  path  deviation  (5),  being  the  vertical  distance  from  the  nominal  path. 

A  mathematical  formulation  of  the  approach  path,  including  a  derivation  of  the  formulae  for  determining 
along  track  diatanoe,  cross  track  deviation  and  vertical  path  deviation  is  presented  by  Erkelens,  L.J.J., 
(1978).  In  figure  3  the  computations  have  been  summarized  in  a  flow  diagram 

2.2  Selection  of  the  approach  paths  for  simulation 

In  the  simulation  program  a  number  of  seven  different  approach  paths  were  chosen.  Fixed  values  with 
respeot  to  turn  radius  and  angle  of  descent  have  been  established  for  all  approach  pathB,  being  2778  m 
(1.5  nm)  for  the  turn  radius  and  3  degrees  for  the  angle  of  deBocnt.  This  turn  radius  requires,  at  a  speed 
of  62.3  a/*  (160  kts)  a  bank  angle  of  approximately  lb  degrees, 

Furthermore  the  various  horizontal  approach  path  profiles  have  been  defined  by  oombuning  three  turn 
angles  (b5°>  90°  and  180°)  with  three  lengths  of  the  final  segment.  The  length  of  the  final  approach  seg¬ 
ment  has  been  chosen  in  such  a  way  that  the  transition  from  the  curved  to  the  final  segment  takes  place  at 
altitudes  of  122  m  ( Uoo  ft),  305  m  (1000  ft)  and  457  (1500  ft)  respectively.  The  122  m  height  wau  selected 
beaause  &  curved  approach,  including  a  final  intercept  altitude  of  122  m,  might  create  a  solution  for  the 
noise  abatement  problem  of  runway  19  R  at  Sahiphol  airport. 

The  length  of  the  preturn  segment  has  been  established  on  2,5  nm,  corresponding  to  a  distance  covered 
during  a  flight  of  approximately  one  minute  with  a  speed  of  160  kts. 

A  summary  of  the  aharacteriatio  parameters  of  the  seven  seleoted  approach  profiles  is  presented  in 
table  1.  Figure  h  shows  the  horizontal  profiles,  depicted  in  the  map  of  thu  visual  display  model. 


3  GUIDANCE  PRESENTATION 

3. 1  General 

In  order  to  determine  the  aircraft  position  relative  to  the  desired  approach  path,  the  following  ground 
facilities  must  be  available  for  an  actual  curved  approach: 

-  a  MLS  elevation  transmitter,  yielding  the  elevation  angle  0, 

-  a  MLS  azimuth  transmitter,  yielding  the  azimuth  angle  i|( 

-  a  precision  DME  transmitter,  yielding  the  slant  range  p. 

Both  elevation  and  azimuth  transmitters  supply  conical  0  and  planes  according  to  the  characteristics  of 
on  actual  MLS.  For  each  arbitrary  approach  path,  being  within  the  space  determined  by  the  MLS  coverage 
limits,  guidance  can  then  be  obtained.  ' 

The  provided  0,  1(1  ani  P  data  will  have  to  be  transformed,  by  onboard  computations,  into  aircraft  po¬ 
sition  relative  to  the  selected  approach  path.  A  derivation  of  the  formulas  for  these  computations  iB  pre¬ 
sented  by  Erkelens,  L.J.J. ,  (1978), 

The  simulated  MLS  azimuth  and  elevation  sites  are  assumed  to  be  located  on  the  normal  IL8  loaalizer 
and  glide  path  antenna  sites,  The  DME  is  assumed  to  coincide  with  the  azimuth  transmitter.  In  the  present 
investigation  the  azimuth  transmitter  has  been  positioned  on  the  extended  centreline  at  a  distance  of  305  m 
(1000  ft)  behind  the  runway  end,  whereas  the  elevation  antenna  has  been  located  305  »  (1000  ft)  behind  the 
runway  threshold  and  ut  a  lateral  distance  of  120  m  ( 394  ft)  from  the  centreline.  The  simulated  runway- 
length  amountB  to  3353  m  (11000  ft). 

3.2  Scaling  of  cross  track  and  vertical  path  deviations 

Along  the  segmented  approach  path  the  cross  track  and  vertical  path  deviations,  n  and  t  respectively, 
can  be  scaled  to  angular  errors,  corresponding  with  glide  slope  arid  localizer  errors  in  the  ILS  case. 

The  requirements  for  ILS  localizer  and  glide  slope  sensitivities  are  provided  by  ICAO  (1968).  Application 
of  these  requirements  on  the  afore-mentioned  runway  length,  azimuth  aptenna  location  and  the  specified  approach 
path  angle  of  descent  leads  to  the  following  sensitivities: 

-  an  angular  localizer  deviation  of  ±  1.68  degree  for  a  2-dots  localizer  needle  deflection,  corresponding 
to  tho  maximum  localizer  current  of  150  U  A. 
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-  an  angular  glide  elope  deviation  of  -  0.72  degree  for  a  2-dote  glide  slope  needle  displacement,  corres¬ 
ponding  to  the  maximum  glide  path  current  of  150yA, 

Thi*  angular  proportionality  vill  provide  an  increasing  sensitivity  as  the  aircraft  approaches  the  touch¬ 
down  point,  which  is  in  agreement  vith  the  usual  ILS  guidance  practice. 

however,  when  the  aircraft  ie  very  far  from  touohdovn  it  would  not  he  rational  to  maintain  a  sensiti¬ 
vity  which  altera  vith  diitance.  Therefore  the  angular  arror  scaling  has  been  applied  only  from  a  certain 
ATD  down  to  touchdown.  When  the  aircraft  ie  further  away  than  this  particular  ATD,  the  scaling  will  he 
related  to  fixed  cross  track  and  vertical  path  distances,  For  both  lateral  and  vertical  path  errors 
different  ATD's  have  been  established. 

The  maximum  values  for  the  off-trnck  distances  in  this  simulation  investigation,  have  beuh  esta¬ 
blished  on  1*00  m  for  the  cross  traok  deviation  and  150  m  for  the  vertiaal  path  deviation.  The  scaling 
ha*  been  depicted  in  figure  5. 


3.3  Flight  dirootor 

The  flight  direetor  was  programmed  on  an  BAI  630  analog  computer.  The  ILS  tracking  mode  of  the  DC-10 
flight  direotor  has  been  used  for  the  basic  flight  director  model.  Block  diagrams  of  the  pitch  and  roll 
bar  drive  are  presented  in  figures  6  and  7  respectively. 

The  following  modifications,  compared  to  the  original  ILS  tracking  mode,  were  applied* 

Bjjjjfljas.  stamaLAElSi . 6) 1  ,  ...  , 

During  the  turn  the  veriine  function,  normally  used  in  the  localizer  intercept  mode  was  switched  on, 
supplying  elevator  commands  to  compensate  for  bank  angle  during  curved  segment  tracking. 
roll  .bay  Channel.  (Fig.  7)  I 

When  the  aircraft  is  proceeding  along  the  curved  segment,  tracking  line  to  be  performed  about  a  biased  foil 
angle  attitude,  The  roll  angle  bias  la  dependent  on  the  aircraft  velocity  and  turn  radius.  In  the  present 

simulation  the  roll  angle  bias  <p0  was  determined  originating  from  a  fixed  nominal  airspeed  of  160  kts  and 

a  turn  radius  of  1.5  nm,  yielding  ip.  ■  it*  degrees.  During  the  turn  this  additional  tp0  signal  was  BUmmod 
via  a  low-paas  filter  with  the  localizer  error  oignal. 

Traneition  from  a  straight  to  a  circular  path  and  reverse  would  require  an  instantaneous  ohange  in 
roll  angle.  In  case  of  an  actual  aircraft,  the  entry  of  a  turn  will  take  Borne  time-  So  in  order  to  deliver 
the  aircraft  on  the  desired  circular  path  with  a  roll  angle,  required  for  the  particular  turn  radius  and 

speed,  the  roll  command  has  to  be  initiated  some  distenoo  before  reaching  the  end  of  the  pretum  segment, 

For  the  stum*  reason  the  exit  from  the  turn  has  to  start  before  the  final  segment  is  reached.  The  distance 
covered  during  entering  or  terminating  a  steady  turn  wan  dctermined(  for  the  present  simulation  a  distance 
of  approximately  165  m  (0.1  nm)  has  been  applied. 


Initially  only  the  two  above-mentioned  provitiionB  bad  been  applied  to  the  existing  roll  bar  drive. 
During  low  aloud  baoe  approaches  the  pilots  complained  that  the  flight  director  did  not  bring  them 
on  the  desired  final  appronah  track  after  paesing  ihe  turn  completion  point.  It  turned  out  that  in  the 
existing  roll  attitude  loop  (see  Fig.  7)  a  washout  filter  with  a  time  constant  of  6o  seconds  caused  this 
trouble.  Arter  the  ip0  signal  is  switched  off  the  roll  bar  signal  will  contain,  due  to  this  large  time  con¬ 
stant,  a  remnant  roll  signal  for  a  considerable  time.  The  problem  was  Bolved  by  reducing  the  time  constant 
to  16  seconds  and  be  reaetting  the  lagged  roll  filter  (t  ■  30  s)  and  the  washout  filter  (t  ■  13  u)  after 
the  tp0  signal  has  been  terminated  by  the  turn  ewitoh. 

After  this  modification  had  been  applied  no  further  remarks  about  this  item  were  made  by  the  pilots. 
The  discussed  modifications  are  indicated  by  dashed  lineB  in  figures  6  and  7, 

3.6  Horizontal  situation  indicator 

The  horizontal  aituation  indicator  (HBI)  could  operate  in  two  different  modes  I 

-  "normal  ILS  mode".  In  this  case  the  position  of  the  aircraft  relative  to  the  extended  centreline  of  the 
runway  is  displayed, 

-  "MLB  mode".  In  this  mode  the  instrument  indicates  the  position  of  the  aircraft  relative  to  thB  desired 
track  of  the  particular  approach  path. 

In  the  left  DUE  window  of  the  HSI  the  along  track  distance  wur,  displayed  it)  both  the  normal  ILS  and 
the  MLS  mode . 

3.5  Pictoral  display 

A  Tektronix  1* 32  oscilloscope  (screen  dimensions  10  x  8  cm)  wsb  used  to  display  the  horizontal  and 
vertical  profile  of  the  selected  curved  approach  path.  Moreover  the  picture  vae  supplemented  with  the  momen¬ 
tary  position  of  the  aircraft,  The  image  on  the  CRT  was  generated  by  the  analog  computer. 


6  SIMULATED  TYPE  OF  AIRCRAFT 

Since  an  aircraft  with  high  mans  and  inertia  properties  may  be  expected  to  be  critical  with  respect 
to  the  curved  approach  capability,  a  wide-body  type  of  air  '-aft  wbb  used  in  the  simulation,  having  the 
characteristics  of  a  li-767  aircraft. 

The  approach  condition  with  gear  down  and  flap.*  fully  deflected  was  simulated.  The  simulated  aircraft 
mans  rind  c.g.  position  wore  chosen  265000  kg  (maximum  lending  toight)  and  25  %  mne  (mid  c.g.  position) 
respectively.  In  that  case  the  reference  speed  ia  73.0  m/s  (11*2  lita);  taking  into  uccount  a  correction 
for  the  ccncidcrcd  wind  ."'ndlti^nn,  the  final  approach  apood  becomes  82.3  m/s  (  160  kts). 

This  simulated  aircraft  watt  provided  with  a  yaw  damper  and  an  autothrottle. 
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Tine  histories  of  responses  of  the  simulated  aircraft  have  been  compared  vith  time  responses  of  the 
actual  B— 7*+7  aircraft  derived  from  Hanke,  R.C.  (1970). 

A  good  agreement  appeared  to  exist  vith  respect  to  the  dynamics  of  the  simulated  and  the  actual  air¬ 
craft,  both  symmetric  and  asymmetric;  also  a  comparison  between  the  dynamic  characteristics  of  the  simu¬ 
lated  and  the  actual  aircraft  vas  carried  out  by  an  evaluation  pilot.  He  considered  the  characteristics 
and  control  forces  in  good  agreement  vith  those  of  the  actual  aircraft. 


5  TEST  FACILITY 

5.1  NLR  moving-base  flight  simulator 

The  NLR  has  at  its  disposal  a  versatile  moving-base  flight  simulator  especially  designed  for  research 
purposes.  Sophisticated  systems  and  components  have  been  used  to  achieve  a  simulation  of  real  flight  ae 
realistio  as  possible  in  all  the  considered  aspects. 

The  single-seat  cockpit  of  the  flight  simulator  vas  mounted  on  the  four-deTgrees-of-freedom  motion 
system  (see  Fig.  8). 

The  installed  Singer/Link-Mile*  Mark  V  Visual  System  comprises  a  rigid  three-dimensional  model, 
scaled  at  £000  t  1,  to  represent  an  aera  of  13.2  x  5.2  nautical  miles  including  an  airfield  vith  Category 
II  lighting  and  a  surrounding  terrain.  The  model  is  viewed  through  a  closed-circuit  oolour  television 
system. 

Visibility  effects  such  ss  olouds ,  haze  and  fog  are  introduced  by  electronically  altering  the  terrain 
image.  The  visual  scens  appearing  on  the  monitor  is  collimated  to  provide  infinity  images  throughout  ths 
range  of  normal  head  movement. 

5.2  Cockpit  instrumentation 

A  picture  of  the  instrument  panel  including  the  simulated  outside  view  is 
presented  in  figure  9.  As  can  be  seen  the  normal  instrument  panel  is  supplemented  by  a  pictorial 
display,  deccribed  in  section  3.5. 

Tvo  additional  instruments  have  been  installed  indicating  the  aircrafts  azimuth  and  elevation  angles 
relative  to  the  MLS  sites. 


6  DESCRIPTION  OF  THE  TEST  PROGRAM 

6 . 1  Approach  procedure 

Each  approach  vas  started  vith  the  aircraft  in  the  final  approach  configuration  vhich  implied  that  no 
configuration  changes  (gear,  flaps)  had  to  be  applied  by  the  pilot  vhile  performing  the  approaah. 

Before  each  simulated  approach  vns  initiated  the  aircraft  vas  released  from  an  initial  condition, 
vhich  can  be  described  as  follovsi 

-  aircraft  trimmed  for  an  airspeed  of  82.3  m/s  ( l6o  kts)  (V  f  +  20  kts)  and  the  oorreat  rate  of  descent 

for  a  3  degrees  glide  path.  Heading  corrected  for  the  prevailing  wind, 

-  aircraft  position i  at  the  beginning  of  the  preturn  segment.  An  initial  off-traok  deviation  has  been 
applied  of  }  dot  on  the  deviation  indicators  right  and  above  the  nominal  approach  path. 

The  pilot  initiated  the  start  of  the  approach  by  pushing  the  "operate”  button.  One  second  before  the 
roll  aommand  on  the  flight  director  for  turn  entry  vas  activated  a  turn  annunciator  on  the  instrument 
panel  was  alluminetod,  varning  the  pliot  that  the  roll  command  for  the  turn  waB  about  to  arrive.  One 
second  before  the  roll  command  for  the  turn  exit  vas  activated  the  annunciator  vas  switched  off. 

During  the  final  approach  Begment  no  marker  (e.g.  middle  marker)  signals  were  simulated. 

The  pilots  did  use  the  flight  director  as  the  primary  instrument  for  approach  guidance.  However,  also 
a  horizontal  situation  indicator  vas  available,  vhich  could  operate  in  the  normal  ILB  mode  or  in  the  modi¬ 
fied  (MLS)  mode  (sec  section  3.*0,  the  selection  between  thene  modes  was  vithin  pilots  discretion. 

For  monitor  purposes  the  pictorial  display  and  azimuth  and  elevation  indicatore  were  available.  By 
meanB  of  approach  charts  the  pilots  vers  informed  about  the  altitude,  along  track  distanco,  azimuth  and 
elevation  angle  at  the  check  points  TIF  and  TCP. 

6.2  Meteorological  conditions 

The  practicability  of  the  seven  selected  approach  profiles  has  been  investigated  under  three  differ¬ 
ent  meteorological  conditions  w^,  vg  and  v^,  vhich  are  specified  in  figure  10. 

Au  appears  tvo  numbers  have  been  used  for  indicating  the  cloud  base,  This  is  due  to  the  fact  that 
for  aloud  break  simulation  a  transition  range  of  30  m  (100  ft)  is  used  in  the  visual  system  in  order  to 
account  for  a  realistio  presentation  of  the  cloud  break  phenomenon. 

The  wind  shear  profile  did  contain  shear  gradients  of  0.17  (10  kts  per  100  ft),  whereas  a  fixed 

vind  direction  vas  assumed.  The  present  wind  shear  is  based  on  the  ICAO  estimation  that  wind  Bhears  in 
excess  of  10  kts  per  100  It  may  be  expected  on  4  per  1000  approaches  and  take-offs.  It  has  to  be 
emphasized  that  the  applied  shear  gradient  is  much  stronger  than  the  wind  shear  of  .  07  ( It  kts  per 

100  ft)  considered  in  FAA  Advisory  Circular  120-29  (1970),  with  respect  to  flight  director  and  auto¬ 
pilot  approval  conditions.  Oince  tho  runway  heading  waB  240°,  on  final  a  left  crosBwind  of  7-7  m/s 
(15  kts)  existed  for  condition  w1  and  w£  (altitude  >  6o  m).  Under  condition  w^  (altitude  >  30  a)  a  right 
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crossvind  of  2,6  m/a  (6  kta)  was  experienced. 

The  atmospheric  turbulence  generated  during  the  simulation  was  based  on  the  model  of  Jansen,  C.J. 
(I9J7).  This  model  is  capable  of  generating  time  histories  which  reproduce  the  quality  of  "intermittency". 
The  non-Oaussian  distribution  of  velocity  differences  in  reel  atmospheric  turbulenae  is  connected  to  thie 
quality.  The  intermittency  can  be  controlled  by  a  single  parameter  F,  and  woe  selected  in  this  simulation 
to  a  moderate  value  (F  ■  0.2). 

6,3  Experimental  design 

The  total  experiment  was  divided  into  two  programs.  During  the  first  program  only  two  weather  condi¬ 
tions  were  considered  (w^  and  Vg).  The  first  sessions  for  each  pilot  did  concern  IDS  approaches  so  as  to 

become  familiarized  with  the  flight  simulator.  During  the  remaining  sessions  various  MLS  approach  paths 
vere  executed  for  condition  w^  and  wg  in  &  pseudo-random  sequence. 

In  the  additional  program  only  weather  condition  v,  was  considered.  No  ILS  sessions  ware  performed 
and  the  sessions  for  the  various  MLS  approach  paths  vere  also  presented  randomly  to  the  pilots.  Finally, 
it  has  to  be  remarked  that  undar  veather  condition!  w,  and  v£  the  autothrottle  was  operating,  whereas 
under  condition  w^  the  throttle  was  controlled  manually. 

Each  session  was  divided  into  a  familiarisation  part  and  a  teet  part.  It  was  composed  as  follows  1 

-  1  familiarisation  ILS  approach 

-  2  familiarization  MLS  approaches  of  the  approach  profile  concerned 

-  5  teet  MLS  approaches  of  the  same  profile. 

The  weather  condition  was  kept  constant  during  one  session.  The  pilot  wsb  only  informed  about  the  aloud 
base,  runway  visual  range  and  surface  wind.  The  impression  was  given  to  the  pilot!  that  wind  shear  could 
occur  randomly  over  the  runs  of  one  session,  although  the  same  wind  shear  model  wee  maintained  during 
a  session. 

After  each  test  run  the  pilot  was  asked  to  fill  up  a  pilot  rating  aard.  After  the  session  had  been 
completed  a  debriefing  followed,  during  which  the  pilot  waB  asked  to  fill  up  a  queationnaira  and  to  give 
oral  comments  on  several  items,  which  were  tape-recorded.  Moreover  he  was  allowed  to  give  free  comments . 

Besides  these  subjective  results  also  objective  data  were  obtained.  During  two  points  on  the  approaoh 
a  number  of  parameters  were  recorded  concerning  the  position  of  the  airoraft  relative  to  the  nominal 
approach  path  and  its  vertical  and  horizontal  speed.  The  data  vere  recorded  at  the  following  momentsi 

1)  when  passing  the  turn  completion  point  TCP,  that  iB  when  the  along  track  distance  (ATD)  of  the  airoraft 
is  squeal  to  the  ATD  of  the  TCP, 

2)  when  passing  the  "100  ft  window",  that  is  when  tho  along  truck  distance  of  the  aircraft  is  equal  to 
502  m  (0. 31?  nm),  corresponding  to  a  nominal  approach  path  altitude  of  30  m  (100  ft). 

Since  3  pilots  were  participating  in  the  simulation  experiment,  and  three  Weather  oonditions  had  been  con¬ 
sidered  a  total  of  63  MLS  sessions  were  performed. 

6,  It  Pilots 

During  the  tost  phase  the  simulated  aircraft  including  the  instrumentation  was  evaluated  by  a  13-747 
co-pilot  of  the  KLM  (Royal  Dutch  Airliner).  This  pilot  did  not  participate  in  the  further  investigation. 

Two  othor  KLM  pilots,  a  B-747  co-pilot  and  a  DC- 10  CD-rilot  respectively  and  an  engineering  pilot 
of  the  HLD  (Department  of  Civil  Aviation  of  the  Netherlands),  involved  in  airworthiness  flight  testing 
and  with  DC- 10  airline  experience,  participated  in  the  simulation  experiment. 


7  TEST  HEUULTS 
7.1  Objective  data 

As  mentioned  in  section  6.3  at  two  points  of  tho  approach  path,  data  with  respect  to  aircraft  Btate 
and  relative  position  to  the  nominal  approach  path  have  been  recorded.  These  points  arei 

-  the  100  ft  point, 

-  the  turn  completion  point  (TCP). 

Meusurod  data,  concerning  the  localizer  and  glide  slope  deviations  for  tho  simulated  approaches  at  these 
datum  points  have  been  summarized  in  histograms. 

for  the  purpose  of  airborne  system  evaluation  by  the  FAA  (1970)  n  definition  is  given  for  a  successful 
approach.  Concerning  glide  slope  and  localizer  deviations,  according  to  this  reference,  a  successful 
approach  is  one  in  which  at  the  100  ft  point: 

-  tho  deviation  from  the  glide  slope  doeB  not  exceed  t  75  PA  corresponding  to  £  1  dot  on  the  ILS  indicator, 

-  the  airplane  is  positioned  so  that  the  cockpit  is  within,  and  tracking  so  as  to  remain  within,  the  late- 
rul  cutifines  of  the  runway  extended. 

80  far  as  the  present  investigation  iu  concerned,  the  maximum  acceptable  deviation  becomes  t  25  PA 
corresponding  to  i  4  dot. 

The  above  mentioned  deviations  of  75  pA  and  25  pA  yield  the  "100  ft  window",  as  indicated  in  figure  10. 

With  respect  to  the  path  deviations  at  the  turn  completion  point  (TCP)  a  window  Iibb  been  indicated  in 
figure  1  1  tuned  on  a  deviation  of  ±  35  PA  (i  0.47  dot)  on  the  indicators  for  both  glide  slope  and  loca¬ 
lizer  error.  The  value  of  ±  35  PA  lias  also  been  derived  from  FAA  (  I9T0)  and  is  related  to  the  performance 
for  category  II  flight  director  approval. 

The  dimensions  of  both  tho  100  ft  und  the  TCP  window  are  presented  in  the  table  of  figure  11. 

Biiice  the  participating  pilots  after  all  did  consider  profiles  1  ami  2  (TCP  at  122  m  (400  ft))  un¬ 
acceptable  with  a  view  to  standard  airline  operation  routines,  separate  histograms  were  presented  for 
approach  profiles  huving  their  TCP  at  122  m  (profiles  1  and  2)  and  profiles  having  the  TCP  at  305  m  or 
above  (profiles  3  through  7). 
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Because  of  lack  of  data  for  the  ILL!  approaches  under  veather  condition  v^,  in  figures  IS  and  13  only  histo¬ 


grams  for  v,j  and  are  presented  for  the  ILO  case 


Comparing  the  histograms  of  localizer  deviation  at  the  100  ft  point  for  ILS  and  MLS  approaches  (con¬ 
dition  v.  and  v-  only)  it  can  he  concluded  that  ths  distributions  far  profilss  3  through  T  and  for  the  ILS 
approaches  are  Suite  similar)  whereas  for  profiles  1  and  2  the  histograms  show  greater  deviations  (ass 
Fig.  12).  It  appears  that  the  tracking  errors  for  the  w,  condition  are  much  greater  than  those  for  the  v, 


and  v2  conditions. 


So  far  at  ths  glide  elope  deviation  is  concerned  (Fig.  13)  it  appears  that  no  significant  differences 
sxist  between  the  histograms  for  ths  MLS  approaches  .end  the  histograms  for  ths  ILB  approaches,  concerning 
the  Wj  end  w£  conditions. 

For  the  conditions  w,  end  w  ,  where  no  shear  effects  are  present  at  ths  moment  of  observation,  ths  air¬ 
craft  it  generally  above  the  nominal  glide  path.  Moreover  many  data  are  exceeding  the  +  75  MA  (1  dot)  lisiit. 

The  distribution  of  date  points  for  profiles  1  end  2  in  the  v,  condition  differs  considerably  from  that 
of  the  profile  series  3  through  7.  J 

As  is  clearly  illustrated  by  a  mutual  comparison  of  the  glide  slope  deviations  of  conditions  1  and  3 
(no  wind  shear  effects  at  the  moment  of  observation)  and  the  condition  2  (shear  effeot  present),  the  mean 
value  of  the  distributions  for  conditions  without  wind  shear  indicates  on  "above  glide  path"  poeition, 
whereas  in  the  wind  shosr  csss  a  mean  "below  glide  path"  results. 

Histograms  of  the  data  st  the  completion  point  (TCP) ,  classified  to  the  height  of  the  TCP  (122,  303 
or  437  m),are  preientod  in  figures  111  end  13  for  localizer  and  glide  slops  deviations  respectively.  As  sppsars 
from  figure  lH  almost  all  data  points  aru  situated  on  the  left  side  of  the  looalizer,  indicating  that  the 
airoraft  ended  the  turn  alvaye  on  the  inner  side  of  the  turn  which  is  due  to  the  fact  that  during  the  turn 
a  constant  roll  angle  signal  ip0  was  added  to  the  roll  bar  drive,  leading  to  a  turn  radius  of) 

m  V2ground 
g  tan<P„ 

o  % 

This  yields  ths  oorreat  ground  track  in  a  no-wind  condition,  If  wind  is  present*  however,  for  an  approach 
profile  having  a  180  degrees  turn,  the  aircraft  initially  meet!  a  tailwind  on  the  circular  segment  which 
gradually  changes  into  a  headwind  on  the  final  part  of  this  segment.  he  resulting  variable  ground  speed 
will  move  the  arioraft  initially  to  the  outereido  of  the  oircular  segment,  due  to  the  increasing  turn 
radius .  After  the  tailwind  has  been  altered  into  a  headwind  the  aircraft  vill  move  to  the  innerside  of 
the  segment  ,  due  to  the  reducing  turn  radius. 

The  tracking  errors  resulting  from  the  above  mentioned  deviations  will  generate  additional  roll  angle  sig¬ 
nals  for  the  roll  bar  drive. 

The  effect  is  presented  in  figure  16  showing  the  actual  airoraft  tracks  relativo  to  the  nominal 
track  of  approaoh  profile  7  for  the  three  wind  conditions  considered. 

The  presence  of  headwind  on  t.he  last  part  of  the  circular  segment  explains  the  concentration  of  data 
points  on  the  left  side  of  the  localizer  at  TCP. 

This  unwanted  behaviour  of  the  simulated  flight  director,  which  can  be  solved  by  exchanging  the 
constant  roll  angle  command,  an  applied  in  the  present  simulation,  for  11  variable  -  ground  Bpeed  depen¬ 
dent  -  roll  angle  command,  1b  also  clearly  illustrated  if  the  localizer  deviation  histograms  for  eor.di- 
tioh  Vg  are  compared  with  the  pilots  for  w,  and  v,.  The  wind  during  the  greater  part  of  the  turn  was 
10  kts  in  the  wg  condition  and  30  kts  in  the  Vj  and  «3  condition.  In  the  wg  ease  the  localizer  deviations 
are  substantially  smaller  for  all  considered  profiles. 

The  offeet  of  wind  shear  on  the  glide  path  tracking  accuracy  at  "OP  oan  be  observed  if  the  glide 
slope  deviation  plotB  for  w2  and  w3  are  compared  (Fig.  15).  The  wind  'hear  of  condition  wg  (increasing 
headwind)  is  responsible  for  the  fact  that  the  aircraft  is  generally  above  the  glide  path  at  TCP,  where¬ 
as  the  shear  of  condition  V3  (decreasing  headvind)  yields  glide  elope  deviations  at  Tt.!.  in  the  oppoelte 
direction. 

As  oan  be  seen  from  the  glide  slope  deviation  at  TCP  for  approach  puthB  3  through  7  the  data  points 
are  almost  all  within  the  35  1)A  range,  vhereas  a  substantial  part  of  the  points  for  approaoh  paths  1  and 
2  are  outside  the  35  wA  range, 

7.2  Subjective  data 

7.2.1  Pilot  effort  ratings 

After  each  teat  run  wus  completed  the  pilot  filled  up  an  effort',  rating  card  to  indiaate  the  amount 
of  effort  he  had  to  spend  on  the  following  items t 

-  horizontal  path  tracking 

-  vertical  path  tracking 

-  airspeed  control 

-  total  approach  execution 

The  individual  ratings  have  been  normalized  so  as  to  enable  a  comparison  between  the  ratings  of  the 
three  individual  pilots. 
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The  normalization  has  been  carried  out  according  to  the  formula: 


In  figures  17  the  normalised  effort  ratings  for  the  total  approach  execution  are  presented.  As  appears 
no  obvious  relation  can  be  obtained  between  the  magnitude  of  effort  rating  and  the  type  of  approach  profile. 
The  relative  high  effort  ratings  for  the  IL8  approaches  may  be  due  to  the  effect  of  learning,  because  all 
these  approaches  were  carried  out  at  the  beginning  of  the  test  program.  On  the  contrary,  the  varioua  curved 
MLS  approaches  have  been  executed  by  each  pilot  in  a  random  sequence. 

If  only  the  curved  approaches  are  considered  a  slight  trend  of  increased  effort  cun  be  perceived  for 
the  profiles  1  am  £  (TOP  at  400  ft),  in  particular  this  i«  true  for  the  effort  ratings  for  the  total 
approach  in  the  W3  condition. 

7 .2.2  Pilot  questionnaire 

A  total  number  of  63  questionnaires  have  been  filled  up  by  the  three  participating  pilots.  In  order 
to  provide  a  surveyable  presentation  of  the  responses  to  the  various  questions ,  including  the  relevant  oral 
comments,  the  results  will  be  considered  separately  for  the  spprosch  profiles  finally  considered  "accept¬ 
able"  (profiles  3  through  7)  and  "unacceptable"  (profiles  1  and  2). 

The  score  of  the  responses  for  each  of  the  9  questions  has  been  expressed  in  percentage  of  the  total  number 
of  responoes  for  the  two  series  of  approach  profiles.  The  results  are  presented  in  the  diagrams  of 
figure  18. 

Each  question  will  be  discussed  hereafter. 

question  1 
Preturn  sentient 

Did  you  have  enough  time  to  get  stabilized  on  this  approach  segment? 

^  ^Xn  all  oases  for  both  acceptable  and  unacceptable  profiles  the  response  to  'this  question  has  been 

It  has  to  be  remarked  that  in  this  simulation  experiment  the  length  of  the  preturn  segment  was  fixed 
at  4630  m  (2.5  nm)  and  the  aircraft  vaa  initially  positioned  j  dot  above  and  right  of  the  nominal  path. 


Question  2 


Curved  segment 


Was  the  magnitude  of  the  bank  angle  required  for  tracking  the  curved  segment :  acceptable,  marginal  accept¬ 
able,  too  largc7 


The  answers  marginal  acceptable,  marginal  aoeeptable/too  large  and  too  largu  mainly  came  from  pilot  II, 
who  stated  that  in  the  full  flap  approach  condition  the  bank  angle  is  normally  restricted  to  about  15  de¬ 
grees.  The  turn  in  the  aurved  approaches  with  an  applied  radius  of  277,9., ">■  (l.g  nm)  requires  a  bank  angle 
of  14  degrees  at  a  nominal  speed  of  82.3  m/s  ( 160  kts).  However,  due  to  effects  of  tailwind  and/or  of  pilot 
response  on  tracking  errors  the  actual  bank  angle  may  become  much  larger. 

question  3 
Final  segment 

Did  you  have  enough  time  to  get  stabilized  on  this  approach  segment? 

The  response  score  in  figure  18  explains  why  the  pilots  did  reject  the  approach  path  profiles  1  and  2, 


In  the  next  question  the  pilots  did  express  the  amount  of  effort  spend  during  final  segment  tracking. 


question  4 

Compared  with  the  IL3  approach,  was  the  effort  you  did  spend  on  performing  the  laBt,  part  of  the  final 
upproach 1 

Apparently  more  About  the  same  Even  less 

The  result,  shown  in  figure  10,  indicates  that  a  rignificant  higher  effort  is  required  for  tracking 
the  final  Begraente  of  profiles  1  and  2  than  for  tracking  the  final  segments  of  the  remaining  profiles.  This 
was  also  shown  in  the  analysis  of  the  effort  ratings  given  by  the  pilots  for  the  total  approach  execution 
(see  Fig.  17), 


Question  5i 
Total  approach 

Was  this  approach  acceptable,  with  a  view  to  standard  airline  operation  routines? 

The  answers  to  this  question  wore  given  us  follows : 

Concerning  profiles  3  through  7i 

76  h  yea,  with  the  remark  that  an  improved  flight  director  has  to  be  available.  After  the  flight  director 
roll  bar  improvement,  discussed  in  section  3.3  had  been  applied,  no  more  complaints  about  the 
flight  director  roll  drive  were  given. 

24  <  yes,  so  far  as  the  particular  MLS  approach  procedure  is  concerned! 

no,  with  respect  to  the  magnitude  of  the  bank  angle  during  curved  segment  tracking.  Hub  response 
camo  from  pilot  II  only,  the  large  bunk  angle  remark  haB  also  been  put  forward  under  question  2. 
Concerning  profiles  1  and  2  the  result  was  unanimously :  no.  The  comments  given  on  thiB  item  can  be  summa¬ 
rized  as  1 

-  a  final  intercept  altitude  of  122  m  (400  ft)  is  too  low,  because  too  short  time  for  stabilization  on  final 
is  available. 

In  particular,  if  at  the  final  segment  ehtry  the  aircraft  hac  a  considerable  deviation  from  the  nominal 
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track  it  is  almost  impossible  to  get  the  aircraft  stabilized  before  reaching  the  decision  height. 

Many  of  these  simulated  approaches  vould  have  ioad.,  during  actual  approaches,  to  missed  approaches. 

Question  6 

What  is  your  opinion  about  this  combination  of  intercept  angle/  approach  intercept  altitude? 

-  Ho  objections  to  this  combination 

-  Intercept  angle  too  large)  altitude  correat 

-  Inter  apt  altitude  too  lov(  angle  correat 

.  Combination  of  both  angle  and  altitude  yieldi  problems 

lor  the  profiles  3  through  T  the  pilots  answered  in  all  cases  that  they  did  not  have  objections  to  the 
preeented  combination  of  intercept  angle  and  intercept  altitude.  However,  in  cbbo  of  profile  1  and  2  they  all 
were  of  opinion  that  the  intercept  altitude  of  122  m(ltOOft)  vaB  too  low  for  both  >15°  and  90°  intercept  angles 
(Fig.  1 8 > .  The  pilots  shared  the  opinion  that  with  respect  to  stabilization  the  minimum  safe  altitude  on 
final  shall  be  approximately  305  m  (1000  ft). 

Question  T 


What  do  you  think  about  tha  pictuiial  display? 

-  Very  helpful 

--  I  used  it  occasionally 

-  I  did  r.ot  usa  it  very  much 

For  all  considered  MLS  approaches  the  pilots  did  not  use  the  pictorial  display  frequently,  as  appeared 
from  the  ansvera  given  to  this  question. 

The  following  peroentageu  of  answers  were  yielded! 

For  profiles  3  through  Ti 

07  %  1  did  not  use  it  very  much 

13  f  I  used  it  occasionally 

For  the  profiles  1  and  2  these  percentages  were  94  K  and  6  i  respectively. 

Question  8 

During  which  segment(s)  was  tha  pictorial  display  an  essential  support  to  your  task  performance? 

The  aniwer  to  this  question  was  in  nearly  all  cases!  none. 

Ths  reasons  for  making  no  use  of  this  item  werei 

-  The  approach  profile  geometry  was  rather  simple  so  that  the  need  for  a  monitor  display  was  absent. 

-  The  location  o"  the  pictorial  display  an  the  instrument  panel  was  nuoh  that  the  instrument  was  outside 
the  scanning  range  of  the  pilot  (see  pioture  or  Fig.  9). 

However,  the  pilots  did  agree  that  if  in  cane  cf  a  two  pilots  operation  the  pi lob-not-f lying  would 
be  able  to  monitor  the  approach  on  this  pictorial  display  up  to  the  final  intercept,  this  instrument  aould 
be  of  any  support. 

Another  application  would  be  met  during  the  approach  path  interaeption.  However,  chi*  would  require 
a  modified  lay-out  of  the  presented  image. 

Question  9 

Do  you  consider  tha  approach  equally  well  acceptable  for  airline  operations  with  only  the  aid  of  the  flight 
director  and  the  basic  flight  instruments? 

The  result  for  profiles  3  through  'i  was! 

64  t  yes,  provided  that  the  modified  flight  director  is  available 

36  t  of  the  answers  was  no.  It  appeared  tnat  additional  position  information  waa  desired.  The  pilot 
comments  on  this  question  mainly  contained  the  need  fort 

-  a  modified  horizontal  situation  indicator,  providing  aircraft,  position  relative  to  the  nominal  track, 

-  along  traok  distance  information, 

-  a  turn  annunciator. 

The  monitor  display  and  the  azimuth  and  elevation  indicators  were  not  considered  to  be  necessary. 

It  vill  be  evident  that,  for  the  profiles  1  and  2  the  answer  on  question  9  vbb  unanimously  no. 

T.2.3  Summary  of  pilot  remarks 

Summarizing  the  oral  comments  provided  by  the  three  pilots  during  the  test  program  and  afterwards , 
the  following  notea  can  be  made! 

Approach  path  acceptance 

-  The  approach  profiles  I  and  2  (TCP  at  122  o  altitude)  have  to  be  considered  "unacceptable"  with  respect 
to  standard  operation  routines.  The  most  important  objection  to  the  procedures  is  that  there  is  not 
enough  time  to  stabilize  on  the  final  sepnent.  However,  if  a  suitable  flight  director  1b  available  these 
approaches  can  be  executed  safely  after  some  practice  by  the  more  experienced  pilot. 

The  opinion  of  the  pilots  was  that  possibly  MLB  approaches  of  the  profile  types  1  and  2  may  be  used 
os  on  additional  support  to  existing  curved  approaches  which  are  now  to  be  performed  merely  visually.  Ae 
an  example  the  Canarsie  approach  on  Kennedy  airport  was  mentioned.  In  this  particular  case  the  glide  path 
guidance  could  provide  a  guarantee  chat  the  correct  altitude  along  the  approach  is  maintained. 

Due  to ‘he  high  effort  the  pilot  has  to  spend  on  tracking  this  very  short  final  segment,  the  approach  is  eon- 
siderjfl  to  be  not  applicable  for  merely  noise  abatement  purposes, 

-  The  remaining  approach  profiles  unanimously  have  been  considered  "acceptable".  The  general  opinion  existed 
that  the  magnitude  of  the  interception  angle  was  unimportant)  the  only  decisive  parameter  vae  the  altitude 
at  TCP.  Hardly  any  practice  is  required  to  perform  these  approaches. 
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One  pilot  did  consider  the  bonk  angles  occuring  during  the  turn  too  large,  vhile  another  did  inly 
complain  incidentally  about  this  item. 

The  use  of  autothrottles  is  of  essential  importance  for  the  execution  uf  curved  approaches,  thus 
enabling  the  pilot  to  pay  full  attention  to  the  horizontal  en  vertical  tracking  tasks. 

Flight  director 

-  All  three  pilots  did  comment  that  the  pitch  bar  was  too  alow. 

-  Initially  the  flight  director  did  not  bring  the  aircraft  directly  on  the  final  approach  segment.  After 
the  additional  adjustments  were  carried  out,  this  trouble  disappeared. 

-  The  lack  of  wind  compensation,  during  the  curved  Segment ,  in  the  roll  bar  drive  was  experienced  by  the 
pilots  as  inoonvenient ,  however,  they  did  accept  this  difficulty  so  long  as  there  was  sufficient  time 
to  become  stabilized  on  the  final  segment. 

Additional  guidance  Information 

The  HSI  operating  in  either  the  "normal  ILS  mode"  or  the  "MLS  mode"  was  used  by  all  pilots.  There 
was  a  slight  preference  for  operation  in  the  MLS  mode.  This  was  based  on  the  fact  that  in  that  mode  the 
instrument  provides  "all  the  way"  position  information.  In  the  ILS  mode  operation  the  pilot  is  able  to 
carry  out  an  usual  final  approach  intercept,  which  was  considered  by  one  pilot  to  be  Very  advantageous, 
possibly  influenced  by  the  initial  flight  director  roll  channel  problems, 

The  pictorial  display  was  unanimously  considered  to  be  of  minor  importance  to  the  approach  guidance 
support,  moreover,  the  azimuth  and  elevation  indicators  were  considered  to  be  superfluous.  On  the 
oontrnry  the  turn  annunciator  was  experienced  as  a  very  useful  feature. 


8  CONCLUDING  REMARKS 

In  the  present,  simulator  investigation  the  utility  of  a  number  of  seven  laterally  curved  approaches 
with  various  turn  angles  and  final  intercept,  altitudes,  executed  with  a  simulated  wide  body  aircraft, 
has  been  investigated,  assuming  thst  guidance  was  provided  by  a  Microwave  Landing  System  (MLS).  Three 
weather  conditions  have  been  considered  which  included  moderate  turbulence  and  Btrong  wind  shears ,  while 
30.5  ft  (100  ft)  vaa  the  minimum  cloud  base  used  in  the  experiment. 

A  flight  direotor  operating  in  the  ILS  trashing  mode,  supplied  with  minor  modifications  in  the  roll 
bar  drive,  hau  been  used  as  primary  guidance  instrument,  Additional  provisions  have  been  made  to  unable 
the  pilot  to  monitor  the  approach.  These  concerned! 

-  a  modified  HSI,  presenting  aircraft  position  end  heading  information  relative  to  the  curved  approach 
path , 

-  a  turn  annunciator,  warning  the  pilot  that  the  aircraft  id  about  to  enter  or  to  leave  the  curved 
segment , 

-  n  pictoriul  display,  depicting  on  an  oscilloscope  the  horizontal  and  the  verticaL  profiles  of  the 
approach  path,  which  has  to  be  flown  and  moreover  displaying  the  momentary  aircraft  position, 

-  an  azimuth  and  elevation  indicator,  presenting  the  airern ft '»  azimuth  mid  elevation  angles  with  respect  to  the 
simulated  MI,t3  transmitters. 

Originating  from  the  approach  path  geometry  and  guidance  presentation,  as  applied  in  this  investigation, 
the  general  conclusion  is  that  the  acceptability  of  a  particular  approach  path  only  depends  on  the  altitude 
of  the  turn  completion  point  (TOP),  Thu  angle  of  turn  is  not  a  decisive  parameter. 

Laterally  curved  approaches  hava  to  be  regarded  as  impracticable  under  IMC  with  respect  to  standard  air¬ 
line  operation  implementation,  if  tho  turn  completion  point  altitude  ia  much  lees  than  305  m  (1000  l't). 

Provided  that  the  TCP  altitude  in  at  least  305  m  (1000  ft)  the  average  airline  pilot  vill  hardly  need 
any  practice,  according  tc  tho  participating  pilots,  to  perform  these  uppronches . 

Although  l'or  IMC  operations  tho  pilots  disapproved  tho  approach  paths  with  turn  completion  point  (TCP) 
altitudes  of  lean  than  305  m  (1000  ft),  paths  with  substantially  lower  TCP  altitudes  flown  in  VMU  under 
MLB  guidance  ere  estimated  to  be  very  useful  to  support  existing  carved  approaches,  now  being  carried  out 
completely  visually.  As  an  example  the  Canarsie  approach  on  Krmnedy  airport  was  mentioned. 

Depending  on  the  type  of  autopilot  nhd  flight  director,  provisions  have  to  bn  made  with  respect  to  the 
roll  channel  in  order  to  avoid  lurgo  deviations  during  curved  segment  tracking.  Tf  a  ground-fixed  track 
has  to  be  followed,  the  roll  angle  bias  signal  for  roll  control  Biid  roll  bar  drive  has  to  be  made  depen¬ 
dent  on  the  ground  speed. 

The  modified  horizontal  situation  indicator  (HSI),  providing  the  aircraft  position  relative  to  the  nominal 
track,  appears  to  be  a  useful  instrument  for  monitoring.  Also  the  presented  along  truck  distance,  dis¬ 
played  in  the  DM8  counter  was  very  much  appreciated,  c.u  wun  the  presence  of  the  turn  annunciator. 

If  the  above  mentioned  monitoring  aids  are  available  there  is  rio  need  for  an  additional  pictorial  display, 
so  fnr  an  the  tracking  of  thin  very  simple  typo  of  approach  is  concerned.  However,  in  case  of  more  complex 
approach  puthn  and  moreover  during  the  interception  phase  of  the  present  curved  approach  paths  a  pictorial 
display  system  will  be  vary  useful. 

Further  investigation  in  required  in  order  to  decide  whether  the  approach  profiles  qualified  "acceptable" 
ih  the  present  investigation  are  still  practicable  if  the  interception  of  the  MLB  path  and  the  configura¬ 
tion  changes  (flaps,  .landing  geo..')  are  taken  into  account. 
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TABLE  1 

Dimensions  ov  the  selected  approach  path  profiles 


approach 

profile 

number 

altitude 
at  turn 
completion 
point 

m  (ft) 

final 

segment 

length 

km  (nm) 

turn 

angle 

deg 

altitude 
at  turn 
initiation 

m  (ft.) 

ATD 

at  turn 
initiation 

km  (nm) 

1 

45 

4.5  (2.1) 

1 22(  1(00) 

2.3  (1.3) 

2 

. 

90 

6.7  (3.6) 

3 

45 

419  0  375) 

8.0  (4.3) 

4 

303(1000) 

5.3  (3.1) 

90 

533(1750) 

10.2  (5.5) 

5 

180 

762(2500) 

14.5  (7.9) 

6 

90 

686(2250) 

13.1  (7.1) 

457(1500) 
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Fig.  7  Block  diagram  of  simulated  flight  director  roll  bar  drive 
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Fig.  15  Histograms  of  magnitudes  of  glide  slope  deviation  at  the  turn  completion  point  (TCP) 
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PRtTURH  MOMENT 

H  DID  VOil  HAVI  INOUGN  TIM  TO  GIT  tTAIILIZID  ON  THU  APPROACH  SEGMINT  » 


E3  PBOfILEJ  I  A  3  1TCP  AT  4WFT) 
□  PROFILES  3  f  7  {TCP  2  WOPT) 


cuavia  uswm 


1)  DID  VOU  HAVI  ENOUGH  TIME  TO  GIT  STABILIZED  ON  THU  APPROACH  SECML'HT  7 


Fig.  18  Questionnaire  results 


4)  WAT  U  TOUR  OPINION  ABOUT  THU  COMBINATION  OP  INTERCEPT  ANOLI  f  PINAL 
APPROACH  INTCRCIPT  ALTITUDI  ? 


T 


COMBINATION  OP  BOTH  ANOLI  ANO  ALTITUDI  YlllOS  PRQBLIMS 
INTIRCKPT  ALTITUDE  TOO  LOW|  ANOU  I  CORRICT 
INTERCEPT  AN  OLE  TOO  LAROlj  ALTITUDE  CORRECT 
OBJECTIONS  TO  THU  COMBINATION 


0|  PROFILES  IBS  I  TCP  AT  400  PT  ) 
□  PROFILES  3*7  (TCP  21000  PT) 


INCTRUMBHTATION 

7)  WHAT  DO  YOU  THINK  ABOUT  THE  PICTORIAL  DISPLAY  ? 


Fig.  18  Questionnaire  results  (Cont.) 


4)  COMPARED  WITH  THE  ILS  APPROACH,  WAS  THE  EFFORT  YOU  DID  SPEND  ON 
PERFORMING  THE  LAST  PART  OF  THE  FINAL  APPROACH 


PROFILES  112 (  TCP  AT  400  FT  ) 
PROFILES  3  +  7  (  TCP  -X  10CO  FT  ) 


TOTAL  ^PRO/.CH 

S)  WAS  THIS  APPROACH  ACCEPTABLE,  WITH  A  VIEW  TO  STANDARD  AIRLINE 
OPERATION  ROUTINES  ? 


S)  DURINO  WHICH  SEQMENT(S)  WAS  THE  PICTORIAL  DISPLAY  AN  ESSENTIAL  SUPPORT 
TO  YOUR  TASK  PERFORMANCE? 


91  OO  YOU  CONSIDER  THE  APPROACH  EQUALLY  WELL  ACCEPTABLE  FOR  AIRLINE 
OPERATIONS  WITH  ONLY  THE  AID  OF  TMF  FI  ICVT  DIRFfTOR  ANIT  BASIC  ri  HTHT 
INSTRUMENTS? 


Fig.  10  Questionnaire  results  (Cont.) 


Fig.  18  Questionnaire  results  (Cont.) 


4 


38-1 


S 


MODELING  AND  FLIGHT  SIMULATION 
OF  AN  ACTIVE  CONFIGURED  AIRCRAFT 
UNDER  M.L.S.  GUIDANCE 


by 

A.DANESI*,  S.SMOLK.A**  «nd  U.CHINAPPI*** 


I-SUMMARY 


A  nsw  mathematical  formulation  ia  presented  to  integrate  the  differential  aquations 
modeling  a  vuhicle  automatically  guided  along  a  curvilinear  trajectory  by  a  microwave 
landing  aystem.  The  augmented  linear  state  aquation,  representing  the  open  loop  vehiole 
M.L.S.  observer  aystem,  is  given  in  standard  phase  variable  form  in  whioh  the  altitude 
perturbations  from  the  reference  trajectory  and  numbers  of  its  suceasive  derivatives 
are  assumed  as  state  variables  involved  in  a  multi-feedback  flight  control  system  with 
gaine  fixed  for  a  satisfactory  vehicle  transient  behaviour  in  response  to  M.L.S.  link¬ 
up  commands.  The  state  aquation  taken  into  consideration  in  aystem  modeling  will  handle 
separately  the  transfer  function  characteristics  polynomial  while  the  dynamical  effects 
of  the  system  zeros  are  included  in  the  algebraic  output  equation  relating  the  actual 
altitude  perturbationa  tc  the  satate  variables  defined,  rn  a  rather  fictitious  fashion, 
in  a  stats  equation.  The  initial  conditions  to  be  imposed  in  the  integration  process 
must  be  consistent  with  the  physical  initial  conditions  on  the  aatual  trajectory  consi¬ 
dered  in  the  problem  at  hand  and  for  that  purpose  an  original  mathematical  solution  to 
the  problem  of  transforming  the  initial  conditions  imposed  on  the  physical  state  vari¬ 
ables  to  the  correspondent  fictitious  ones,  is  advanced.  Using  this  transformation,, 
easily  performed  with  a  numerical  digital  program,  the  phase  variable  system  represen¬ 
tation  proves  tobe  vary  effective  in  trajectory  simulation  of  a  vehicle  in  which  the 
input  forcing  function  is  defined  in  terms  of  the  state  variable  constrained  to  the 
automatic  flight  control  system.  The  proposed  mathematical  procedure  results  particu¬ 
larly  useful  treating  with  active  controlled  aircraft  configurations  as  shown  in  the 
conclusive  numerical  application. 


2-  FUNDAMENTALS  ON  SYSTEM  PHASE  VARIABLE  REPRESENTATION 


Let  an  n-order  linear  system  described  by  a  differential  state  equations 


-  A  %  u)  +■  B  •'U.(t') 


(1) 


where  the  components  of  the  n-state  vector  x  (t)  are  stated  as  some  particularly  chosen 

output  variable  y(t)  and  its  (n-I)  sucoseiv”  derivatives  i.o.  : 


xtt)  -  |  Vt),  x2 (+), 


*Profe3Bor  in  the  Aerospace  School  of  Enginoering-Rome  University  (Italy)  and 
Visiting  Professor  ut  the  Mech.  and  Aerospace  Eng.  Boston  University , Mass . 
(U.S.A. ) 

M.S.  Associate  Researcher  at  Mech.  and  Aerospace  Eng.  Boston  Univorsit. 
Mass.  (U.S.A.) 

***B.S.  M.S.  Associate  Researcher  on  Aerospace  School  of  Eng. -Rome  U.  (Italy) 


Tha  component!  are  consequently  correlated  by  the  differential  relation: 
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Conaider  the  eye ten  tranafer  function : 

S 

Sr.)  =  ai£  =  tt£ 
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(V) 


relating  the  Laplace  transform  of  the  output  and  oontrol  variable  y(t)  and  u(s),  where 
D(s)  and  N(s)  are  reapeotivaly  the  n-ordar  characteristic  polynomial  and  the  m-ordar 
(  m  <.  n  )  numerator  polynomial  defining  tha  ayatem  poles  and  zeros  on  the  complex  plane. 
At  firat  N (a)  ie  taken  as  an  unitary  scalar  and  using  (3),  the  transfer  funatlon  (4)  is 
translated  in  the  time  domain  yielding  a  differential  state  equation  in  phase  variable 
form  where  the  (nxn)  state  matrix  A.  and  the  (nxi)  oontrol  matrix  B,  have  the  following 
structure:  1  r 


O  i  0  ‘  •  •  o 

o  O  1  o  •  •  *  o 

)  Bp  * 

o 

o 

% 

O  0  0  o  *  •  •  1 

* 

4 

-dD  •  *  *  “®lH 

1 

fir) 


In  the  last  row  of  the  matrix  A.  appear  the  aoeff iaients  of  the  first  (nxl)  power  in  s 
of  the  characteristic  polynomial  D(o)  with  unitary  coefficient  for  the  n-th  power  in  a. 
In  the  above  stated  hypotheses  for  N(s),  the  equation  (I)  in  the  state  vector  x  (t)  de¬ 
fined  in  (2)  assumes  the  phase  variable  form  with  the  state  and  control  matrices  given 
in  (5)  and  striatly  describes  the  dynamical  effects  of  the  system  poles  expressed  in 
D(s).  To  put  into  consideration  the  numerator  polynomial  N'(s)  in  this  representation , 
the  procedure  adopted  will  arise  from  relation  (4)  equivalently  modified  in  the  follow¬ 
ing  form: 
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wherg  y  (s)  is  stated  as  the  Laplace  transform  of  a  fictitious  output  variable  which 
diffara  from  the  original  output  variable  y  (a)  for  the  fact  that  it  is  involved  only 
in  the  denominator  dynamic.  The  fictitious  transfer  function: 


Gc  *)  = 

7^ 
_ 1 

1‘? 

ucs) 

3<4> 

1 

D<s) 


(7) 


in  the  time  domain  ie  represented  by  the  phase  variable  differential  equation  U)  where 
the  state  vector  x  (t)  has  to  be  referred  to  a  fictitious  output  variable  y  (t)  instead 
of  the  actual  output  variable  y(t).  The  fictitious  state  variable  for  the  equation  (1) 
is  defined; 


The  relation  between  the  fiatitious  output  variable  y  (t)  and  the  actual  one  y(t)  is 
obtained  translating  in  time  domain  the  fiotitious  transfer  function; 

!) 
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(9) 


yielding  the  following  algebraic  output  equation; 

-  c  m 


where  the  components  of  the  n-row  vector  C  are  the  coefficients  of  the  m-order  (m  <n) 
numerator  polynomial  N(a)  followed  by  zeros  up  to  the  system  order,  i.e.  ; 


C  -  [ fle  i  }  •  •  *  )  AtfJ  )  0)  •  *  *  >  Oj 


(11) 


The  phase  variable  differential  aquation  (i)  in  the  fiotitious  state  vector  x(t)  (7) 
and  the  algebraia  output  equation^O)  define  completely  the  open  loop  system.  The  com¬ 
ponents  of  the  fiatitious  vector  x(t)  are  supposed  to  be  constrained  to  a  multiple 
feedback  branches  through  a  n-vector  feedback  gain  vector  with  values  fixed  to  ob¬ 
tain  a  satisfactory  behaviour  of  the  actual  output  variable  y(t)  in  response  to  an  in¬ 
put  forcing  function.  The  mathematical  representation  of  the  system  described  by  (1) 
and  (9)  in  closed  loop  configuration  is  obtained  adding  the  control  law; 


alU)*  Crtt)  -  ^  x&J 


when  r(t)  is  a  scalar  input  forcing  function  and  Kg  a  forward  gain  as  depicted  in  Pig. 

1  where  a  phase  variable  feedback  control  system  is  represented.  Substituting  (13)  in 
(1)  yiold.s  the  compact  closed  loop  representation; 


JQ*^ 
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(13) 


where i 


K  ■-  A  -  K,  B  Kn  f 

Be*  Ks  8 


Considering  K#  and  K£fa  already  known  by  computation,  the  dosed  loop  system  representa¬ 
tion  (13)  is  completely  defined  in  terms  of  the  coefficients  of  the  denominator  and  nu¬ 
merator  polynomial  of  the  original  transfer  function  G(b). 

The  integration  of  the  differential  state  equation  in  (13)  requires  the  knowledge  of 
the  initial  condition  vector  «  (0)  defined! 


2'”' Ajjv),  ...,4%$!,] 
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which  ie  generally  different  from  the  physical  initial  condition  state  vector  x  (0) t 

XCO)  '  />) ,  ct  ^(Q) 


referred  to  the  output  vector  x  (t)  describing  the  actual  dynamic  behaviour  in  the 
chosen  primary  controlled  variable  y(t). 

The  problem  of  transforming  the  actual  set  of  the  initial  conditions  (IS)  in  the  corres¬ 
pondent  fictitious  set  (15)  will  be  afforded  in  the  next  section. 


3-  INITIAL  CONDITION  TRANSFORMATION 


The  method  presented  in  this  section  allows  to  transform  the  set  of  initial  condition 
x(0)  in  the  correspondent  set  x  (0)  referred  to  the  closed  loop  state  equation  (13). 
The  linear  transformation  : 


*«)  =  L  '  Tr(t) 


(16) 


was  established  differentiating  (n-1)  times  the  output  equation  (10)  substituting  for 
X  (t)  the  right  hand  expression  of  the  closed  loop  equation  (13)  and  ordination  the  re¬ 
sulting  terms  after  having  defined  a  new  n-input  vectors 


-=  frA<*)  ,  rta) 

=  fr(t) ,  dr  ft) 

L  aft  1 


The  (nxn)  state  transformation  matrix  L  has  the  following  structures 


L  -  [ Li  i  U  i  •  •  •  i  in 7 

(1G) 

=  [ c T  ;(aj)ct!  ■■■  ‘•(AcT'c1] 

which  results  to  be  the  system  observability  matrix.  If  no  pole-zero  aauaellation 
ooaurs  in  the  original  transfer  function  G(s),  that  is  the  system  is  completely  control 
lable,  the  matrix  L  will  be  not  singulars  in  such  hypothesis  premultying  both  sides  of 
aquation  (16)  per  the  inverse  of  L  yields  s 

$(*)  -  l'd  x(t)  4*  ISLT  r'(^) 

(19) 


If  the  matrices  L  and  T  are  given  and  the  matrix  L  is  not  singular,  the  equation  (18) 
allows  to  transform  the  vector  x  ( t )  in  the  correspondent  fictitious  vector  ^  (t) . 

The  control  transformation  matrix  T  is  obtained  defining  the  auxiliary  n-row  vector  M  i 


/1-,  •••  /v i  01 


and  constructing  the  matrix i 
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Imposing  for  t(0)  -  tQ  the  following  initial  condition*  < 

R  (t0>  -  RIO)  j  (*o)  '  *  (°) 
tha  fictitioua  vector  x  (0)  will  ba  obtained  using  (19)  now  becoming  i 


(2i) 


lio)  =  Lmi  %io)  +■  L'1  T  ru>) 


(22) 


Foe  tha  common  aasa  whara  tha  syatam  is  initially  not  in  forced  state,  that  is  > 


R  (0)  -  0  (23) 

tha  transformation  (22)  will  be  reduced  in  the  form  i 


X(0)  =  l‘l  ZCO) 


(24) 


Applying  tha  transformation  (22)  or  (24)  tha  closed  loop  stats  aquation  (13)  may  ba  in¬ 
tegrated  imposing  as  initial  aondition  the  computed  state  vector  $  (0)  for  which  the 
stata  aquation  ara  written.  The  numerical  computations  involved  In  the  linear  transfor¬ 
mation  has  to  bo  performed  by  digital  computer  along  with  the  observability  check  which 
is  essential  for  the  applicability  of  the  present  phase  variable  formulation.  This 
program  may  be  inserted  as  a  subroutine  in  a  general  purpose  integration  program  which 
will  be  entered  in  this  case  with  the  actual  initial  vector  x  (0) 


4-  PHASE  VARIABLE  MODELING  OF  ACTIVE  CONFIGURED  AIRCRAFT 


The  phase  variable  mathematical  formulation  given  in  the  preceding  sections  is  particu¬ 
larly  useful  in  modeling  aative  controlled  vehicles  where  a  number  of  aerodynamic  effec¬ 
tors  are  employed  to  minimise  tha  wing  root  banding  moments  in  flight  maneuvers  (2).  In 
this  case  the  state  equation  (1)  is  written  for  the  open  loop  vehicle-autopilot  system 
with  the  control  matrix  B  sized  (nxr)  ,  where  r  is  tha  number  of  the  aerodynamic  effec¬ 
tors  involved  in  the  vehicle  active  control. 

The  control  matrix  B  is  partitioned  along  columns,!. a.  i 


(25) 


where  the  i-th  element  is  the  (nxi)  control  vector  relative  to  the  i-th  aerodynamic 
effector  asserved  to  one  of  the  r-multichannels  autopilot.  Since  the  state  matrix  A  is 


common  for  all  the  channel  aquation,  the  mathematical  analysis  provided  for  the  case  m 
equal  to  one  will  be  repeated  for  each  i-th  single  channel  considering  the  correspondent 
B,  element  in  the  control  matrix  (25)  .  The  state  variable  equation  pertaining  to  each 

channel  may  ba  written: 


X* 60  »  A  ^4  60  +  &  M:  &)  C  t  •  jl,  i, .  r) 
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In  figure  3  is  given  the  symbolic  state  variable  representation  of  a  double  channel  sys¬ 
tem  where  the  partial  contribution  of  each  single  channel  are  summed  to  yield  the  glo¬ 
bal  system  response  to  the  common  forcing  function  r(t) . 

writing  the  equation  (26)  in  phase  variable  form,  the  control  matrix  B^  becomes  equal 
for  all  channels,  so  this  equation  may  he  rewritten! 


X*t(0  -  Af  %ilt)  +  (i*  4,2, -if) 


In  this  equation  the  output  vector  C  still  appears  to  be  different  for  eaah  channel 
since  the  numerator  polynomial  N(s) ,  reflecting  the  offset,  of  the  control  terms,  is  di¬ 
fferent  in  each  case. 

Beaauae  of  the  system  linearity  and  the  particular  phase  variable  structure  of  the  equa¬ 
tion  (27),  the  contributions  of  all  channel  may  be  sunmed^and  definir-.gt 

A.  JU  <V 
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'  (.’i  > 
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'ir®  *  t  %  (*) 

the  following  multi-channel  state  equation  for  the  system  depicted  in  Figure  4,  was  de¬ 
rived) 
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("t)  ~  60  +  My  (£) 


V*'  =  CT  Sr  M 


CT  =  2  C,  » 


[  Z  (n.i; ;  £  M,  j ...  liwjolo], 

t  <■«'  1  i*l  I  »U|  ‘1  1  J( 


I 


38-3 


In  (31)  appear  the  coefficients  of  the  numeratio  polynomial  N(s)  defined  for  each  con¬ 
trol  channel. 

Observe  that  the  feedback  branches  are  originating  from  a  point  in  the  system  where  the 
signals  are  function  only  of  the  denominator  dynamic  which  is  common  for  all  the  chan¬ 
nels)  oonsequentely  only  a  single  feedback  compensation  through  one  forward  gain  ia 
strictly  necessary  to  control  the  transient  behaviour  of  the  multi-channel  output  sys¬ 
tem.  Computing  the  forward  gain  K#  and  the  feedback  vector  in  order  to  obtain  a 

satisfactory  behaviour  of  the  multi-ohannal  output  variable  y_  (t) ,  the  control  law  re¬ 
main  defined  as:  1 


uT(t)  -  KjrM-kfl  srw] 


Substituting  (32)  in  (28)  yields  the  multi-ohannal  closed  loop  state  equation! 


ST  *  4e  3r  <*)  +  He  r(i) 


(33) 


Ac  -  Af  -  B  ki 
Be  "  Kj  B* 


(34) 


(35) 


with  the  output  variable  yT  (t)  expressed  by  (30) . 
tegrated'  imposing  the  initial  condition: 


The  state  equation  (33)  may  be  in- 


obtained  by  the  actual  initial  condition: 

*T!£>)  *  *T„ 


applying  the  linear  transformation  introduced  in  section  3. 


5-  M.L.S.  TRAJECTORY  SIMULATION 


The  ground  derived  microwave  landing  system  applies  to  the  automatic  flight  control  sys 
tern  input  the  polar  coordinates  of  the  reference  trajectory  fixed  by  the  air  traffic 
control  canter.  In  the  longitudinal  plane  thaaa  are  the  elevation  angle  («4q)  and  the 
distance  Rpfrom  DME  station.  The  polar  coordinates  R^may  be  substituted  by  the 

actual  altitude  hn  in  respect  to  the  V.L.S.  reference  plane. 

Simultaneously  witn  these  information  M.L.S.  stations  (  EL-I  for  tha  initial  ap¬ 
proach  segmant  and  EL-2  for  flare  control-*  aee  (3))  provides  the  emission  of  the  corres 
pondent  desired  altitude  funotion  hQ  (t)  in  the  aircraft  point  position.  All  these  in- 
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formation!  are  sent  via  multi-plexed  ground-air  linking;  in  thia  functions  the  M.L.S. 
system  acts  as  an  observer  of  the  vehicle  motion  in  the  longitudinal  plane  like  a  phy¬ 
sical  sensor  in  a  feedback  system  measuring  the  same  vehicle  output  variable  observed 
by  the  M.L.S.  system  while  the  desidered  coordinate  is  applied  to  the  autopilot  input 
to  form  the  actual  error  existing  in  following  the  desidered  trajectory.  In  this  sense 
the  M.L.S.  transfer  characteristics  can  be  included  in  a  feedback  loop  enclosing  the 
vehicle-autopilot  mathematical  model  in  the  forms  (33) .  Generally  the  M.L.S.  observer 
transfer  function  G0(s)  is  positioned  in  the  system  forward  loop  adding  a  prefilter  a- 

head  the  autopilot  summing  point  to  maintain  the  system  equivalence  and  aggregating  to 
it  the  M.L.S.  -  Autopilot  Coupler  transfer  function  GM(e)  **  depicted  in  Figure  5.  The 
forward  loop  transfer  function  hence  becomes; 


<afcs>  =  G„“>  G0C o  G*  (s) 


(36) 


where  aft(s)  is  the  closed  loop  autopilot-aircraft  transfer  function  selected  for  the 
output  variable: 


»  li  ft) 


(•57) 


In  the  M.L.S.  lateral  guidance  node  the  polar  coordinate  are  the  azimuth  angle  ^  and 
the  distanae  R  from  D.M.E.  station  or  the  resulting  distance  y(t)  from  a  reference  ver¬ 
tical  plane  containing  the  runway  centerline.  In  both  oases  the  open  loop  system  will 
be  closed  by  an  ideal  unitary  feedback  which  represent  the  M.L.S.  observer  link-up. 
Deriving  the  forward  transfer  function  in  phase  variable  form  as  indicated  in  the  pre¬ 
ceding  sections  the  output  equation  will  take  care  of  the  selection  of  the  ahoaen  out¬ 
put  variable  as  primary  variable  in  the  trajectory  simulation,  The  correspondent  in¬ 
put  forcing  function  whiah  describes  the  desidered  trajectory  to  be  followed  by  the  ve¬ 
hicle  on  the  entire  landing  procedure,  will  be  applied  to  the  summing  point  of  the  ideal 
feedbaak  closure  transducing  the  aatual  trajectory  information  from  the  M.L.S.  stations. 

The  global  system  representation  is  given  in  Fig.  5  where  the  closed  loop  autopilot-ve- 
hiole-M.L.S.  observer  system  appears  to  be  forced  by  the  control  law; 


u(-t)  -  Kr  |nDft)  -  \)[t)  (3?) 


6-  NUMERICAL  APPLICATION 


The  generalized  digital  program  given  in  Ref.  (1)  which  includes  the  initial  condition 
state  trensformation  subprogram  has  been  employed  to  simulate  the  M.L.S.  trajectory  in 
a  vertical  plane  of  a  configured  aircraft  treated.  The  vehicle  ia  a  large  body  trans¬ 
port  airaraft  for  which  two  aerodynamic  effectors  moved  by  an  optimized  flight  control 
system  were  provided  to  minimize  wing  bending  moments  in  flight  maneuvers  performed 
using  the  elevators  as  primary  longitudinal  flight  controls.  The  automatic  flight  con¬ 
trol  system  is  supposed  to  operate  as  a  multi-feedbaok  control  system  in  which  the  al¬ 
titude  h(t)  is  considered  as  primary  constrained  variable.  The  altitude  perturbations 
due  to  the  controls  application  and  the  dynamic  effects  of  the  actuating  servosystem 
and  M.L.S.  Coupler  are  described  by  the  transfer  function  of  the  type  (36)  i 


Gjf  cs)  -  -  A/t^) 


(3T) 


whara  tha  seoond  ordar  denominator  polynomial  Ni {*)  aradafinad  for  each  of  the  three 

controle  involved  in  the  longitudinal  maneuver,  i.e.  the  elevatora  and  the  two  active 
effectors.  The  coefficients  of  the  fifth  order  characteristic  polynomial  D<s)  appear 
in  the  last  row  of  the  state  matrix  A  for  the  system  described  in  phase  variable  form 
as  given  below  • 


0  i  .0  0  0  0 

0  0  1.0  0  0 

0  0  0  1.0  0 

0  o  0  0  1.0 

0  -  3.656  -S.037itf  -/7.53  -h.% 


Taking  into  account  the  multi-ahannel  structure  of  the  treated  active  control  system, 
tha  state  equation  will  be  written  as  in  (29)  where  tha  output  vector  ie  obtained 

a^pl^ing  the  relation  (31).  Performing  the  operations  involved  in  this  expression 


Cj  -  [‘371. 6i  ,  3 o.sozt,  n.o ,  o,  0 7 


The  autopilot  forward  gain  Kg  and  the  feedback  vector  Kfb  were  computed  in  order  to  ob¬ 
tain  a  satisfactory  short  period  system  transient  behaviour  to  step  input  command  re¬ 
sulting  ini 

Kfc  =  [-37i.tlr97t.OI6  )-Wel.ienrlCWl-U~] 


k5  -  -H. 


Using  the  above  given  data  the  system  closed  loop  state  equation  (33)  become  available 
to  be  integrated  for  trajectory  study  purpose.  A  typical  M.L.S.  landing  procedure  with 
multi-slope  trajectory  in  a  vertical  plane  was  provided  for  a  digital  simulation  carried 
out  with  the  generalised  numerical  program  given  in  Ref.  (1).  The  initial  conditions 
were  fixed  at  the  trajectory  point  where  the  vehicle  is  crossing  thu  approach  procedure 
gate  in  a  eteady  rectilinear  flight  path  with  a  slope  of  four  degree.  The  veotor  of  ac¬ 
tual  initial  condition  was  established  as  follows  i 

£  -  [  W?  ,  -  0,  0,ol 


The  fictitious  initial  condition  vector  x  (0)  is  computed  by  the  subroutine  which  is  a 
part  of  tha  main  integration  program  (l)rand  the  result  is  printed  in  the  program  output, 

x„T  -  [ - i.on ,  0.722,  -1.7 it,  ,-U on] 


31 


The  forcing  function  applied  to  the  unitary  feedback  c lot ad  loop  system  depioted  in 
Fig.  5  is  representative  of  tht.  trajectory  commanded  by  the  M.L.S.  link-up  multiplexing 
which  are  supposed  to  obey  in  sequence  the  following  desidered  altitude  hQ  (t)  law  : 


X-  For  the  intermediate  approach  segment  (  /  «  4®  ) 

t0^t<  (sec)  :  hoCt'l 

2-  For  the  final  approach  segment  (  -  2,5®  ) 

Hs.ts  <  t‘  <  SS.  7  (sec)  ;  ^  (t) 

3-  For  the  automatic  exponential  flare  maneuver i 

i  >  SS.  7  (sec)  :  Ct) 


3 OH.i  -  S.GSt 

190,1  -3.19* 
-  o. : 

is.  zh  e 


The  exponential  trajectory  is  supposed  to  be  tangent  to  the  horizontal  plane  loaated  at 
7*332  maters  below  the  runway  level  to  allow  for  a  desidered  airoraft  sink  speed  (1*02 
m/sec)  at  the  ground  contact. 

The  autothrottle  control  is  supposed  to  keep  constant  the  air  speed  at  the  value  of  72 
m/seo  along  all  the  considered  landing  trajectory. 


Considering  at  the  initial  time  the  desidered  altitude  and  vertical  speed  coincident 
with  the  actual  flight  values  the  condition  (23)  on  the  initial  unput  vector  R(0)  ap¬ 
plies  so  the  simplified  linear  transformation  (25)  is  automatically  chosen  inside  the 
integration  program  imposing  R(0)  equal  to  zero  as  input  data. 


In  order  to  have  an  enlarged  view  of  tha  dynamical  behaviour  of  the  aircraft  in  the  ter¬ 
minal  flare  maneuver  the  closed  loop  system  equation  was  integrated  supposing  as  actual 
initial  condition  veotori 

x7 --C  ts.iH,  i  o, 


with  the  correspondent  fictitious  vector  resulting  i 


[-o.oWz 


,  0.0306, 


-0.OSO3,  0-  13  f  7,  -o.  3/72J 


The  graphic  results  printed  at  the  program  output  show„in  Fig.  6  the  complete  oi*ti 
and  actual  trajectories  marked  respectively  with'Vand  T'  lattsi's  while  the  (Ufit  identi¬ 
fied  by  letter  E  gives  the  altitude  error  existing  in  following  the  UttireJl  trajec** 
tory.  In  Fig.  7  the  same  representation  is  given  for  the  flare  portion  of  the  landing 
tra jeatory . 
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Fig. 2-Symbolio  phase  variable  representation  of 
feedback  control  system. 
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Fig.tf-  complete  M .L. S . landing  trajectory  nimulation 
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Fig .7-M.L.S. flare  trajectory  simulation  computer  result 


SYMBOLISM 


A  -  State  matrix 

B  -  Control  matrix 

C  -  Output  vector 

D(s)  -  Characteristic  polynomial 

G(s)  «  System  transfer  function 

Gj(s)  «  Fictitious  transfer  function  relative  to  the  denominator  dynamic 

Gj<s)  -  Fictitious  transfer  function  relative  to  the  numerator  dynamic 

GA(e)  -  Closed  loop  aircraft-autopilot  transfer  function 

Gj,  (a)  -  Overall  forward  transfer  function 

Gjj(s)  ”  M.L.S .  Coupler  transfer  function 

G0(s)  ■  M.L.S.  Observer  transfer  function 

L  ■  Initial  condition  state  transformation  matrix 

N(s)  ■  Transfer  function  numerator  polynomial 

M  -  Auxiliary  vector  in  the  initial  condition  transformation 

XR  -  M.L.S.  Receiver  gain 

Kfb  "  F*,db*0,c  gain  vector 

K6  *>  Forward  loop  gain 

T  ■  Initial  condition  control  transformation  matrix 
R  ■  Input  forcing  function  vector 
dA  *  Characteristic  polynomial  coefficient 
n  -  System  order 

n^  -  Numerator  polynomial  coefficient 
m  -  Numerator  polynomial  order 
q  -  Pitch  rate 

r  ■  Number  of  autopilot  channels 
s  ■  Laplace  operator 
u  ■  Scalar  control  variable 
x  ■  System  state  vector 
y  ■  Output  variable 
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MODELING  THE  HUMAN  OPERATOR: 
APPLICATIONS  TO  SYSTEM  COST  EFFECTIVENESS 
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Most  attempts  to  ■improve  overall  system  performance  in  modem  air  weapon 
systems  result  in  changes  to  avionioe  hardware  and  software.  Such  ahangas  are 
designed  to  enhance  system  capabilities  in  data  prooeeeing ,  in  aeeuraoy  and 
quality  of  data  inpute/outpute ,  and  in  the  olaeeee  of  information  available  to 
the  operator.  However,  as  the  interdependenoe  of  system  oomponents  adds 
oompleteity,  it  oan  no  longer  be  aeeumed  that  avionioe  modifiaatione  will  result 
in  actual  improvement  in  system  performance.  The  ability  of  the  operator  to  use 
new  system  features  met  be  considered  in  determining  their  value.  Total  system 
performance  my  increase  only  minimally  or  even  decrease  if  information  provided 
te  not  relevant  to  the  operator's  requirements  or  if  current  task  loading  precludes 
timely  application  of  information.  Mien  system  performance  is  not  enhanced  by  a 
modification,  both  the  intended  purpose  and  the  cost  effectiveness  of  the  system  is 
significantly  degraded.  Previous  approaches  to  predicting  system  effectiveness 
have  fooueed  primarily  on  hardware  and  software  modeling  without  inclusion 
of  realistic  operator/ system  interaatione.  The  technique  described  in  this  paper. 
Operator  Interface  Cost  Effectiveness  Analysis  ( OTCEA),  ropresunts  an  initial 
attempt  to  overcome  this  limitation.  The  methodology  combines  system  modeling 
with  cost  projections  to  evaluate  the  cost  benefits  of  alternative  proposed  deeigne 
within  appropriate  mission  contexts.  Major  avionioe  variables  are  integrated  into 
a  oohesive  approach  which  simulates  hardware  and  software  functions  and  the 
performance  cf  an  operator  interacting  with  these  components,  using  a  model  called 
the  Human  Operator  Simulator.  OICEA  allows  for  systematic  Variation  of  key  factors 
that  influence  effectiveness,  including  degree  and  typo  of  task  automation,  equipment 
and  human  reliability,  scenarios  and  taatioal  doctrine  and  operator  characteristics . 
This  paper  summarises  the  OICEA  methodology  and  documents  applications  to  avionioe 
and  ssnaor  improvements  on  a  fixed  Wing  antisubmarine  warfare  platform. 


L 
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INTRODUCTION 

Modern  air  weapon  systems  must  respond  to  continually  changing  threat,  conditions.  Each  new  threat 
can  give  rise  to  the  need  to  modify  and  update  the  avionics  Hardware  and  software  In  current  systems. 

With  the  Increasing  costs  of  these  changes  and  the  Increasing  need  to  demonstrate  return  on  Investment, 
techniques  have  been  developed  In  recent  years  to  estimate  the  Impact  on  system  performance  of  proposed 
updates.  These  predictions  of  future  effectiveness,  usually  obtained  through  computer  modeling  of  all  or 
part  of  the  system,  have  involved  the  Implicit  assumption  that  Increasing  system  capabilities  will  yield 
a  direct  and  comparable  Increase  in  system  performance.  Experience  with  the  use  of  new  and  updated 
systems  In  the  fleet  has  Indicated  that  this  assumption  Is  not  always  tenable.  Forecasts  of  system  per¬ 
formance  from  conventional  hardware  and  software  models  have  overlooked  an  Important  system  component  — 
the  operator.  In  particular  human  limitations  Impose  a  major  constraint  on  the  utilization  of  system 
Improvements. 


Avionics  modifications  usually  Involve  either  new  hardware  or  new  software  that  Increase  the  degree 
and  quality  of  automation,  or  Improvements  In  the  accuracy  and  sensitivity  of  sensor  Information  and 
other  system  Input/output  data.  Conventional  methods  of  performance  estimation  have  either  ignored  the 
operator  or  have  used  simple  transfer  function  representations,  without  an  adequate  understanding  of  the 
limits  within  which  these  functions  are  applicable.  As  systems  have  increased  in  complexity,  It  Is  no 
longer  adequate  to  assume  that  automation  will  necessarily  produce  Increases  In  performance. 

Inappropriate  automation  may, In  fact,  have  the  opposite  effect,  We  can  no  longer  assume  that  by  giving 
the  operator  more  sophisticated  data,  system  performance  will  automatically  be  Improved,  Additional  or 
more  refined  sensor  data,  for  example,  will  not  Improve  performance  If  It  Is  received  during  periods  of 
heavy  operator  loading  or  if  the  data  exceeds  the  precision  which  the  operator  needs  to  perform  a  given 
function.  Proposed  system  changes  must  therefore  be  evaluated  by  considering  how  well  an  operator  can 
make  use  of  the  new  capabilities  provided  by  the  proposed  changes.  Evaluation  techniques  that  do  not 
consider  this  factor  in  t.helr  estimates  will  be  In  error;  as  operator  loading  approaches  saturation,  such 
estimates  will  become  wildly  optimistic. 


Designers  of  current  and  future  weapon  systems  must  cope  with  several  harsh  realities  that  constrain 
available  design  options,  First,  funds  for  development  and  deployment  of  systems  are  becoming  limited; 
pressures  are  mounting  for  more  cost-effective  utilization  of  fiscal  resources,  Design  decisions  must  be 
made  on  the  basis  of  maximum  contribution  to  the  defense  mission  for  each  dollar  Invested.  Second,  the 
human  Is  no  longer  a  low-cost  component  of  systems;  skilled  manpower  Is  becoming  an  Increasingly  serree 


unkr.ju; 


connodlty.  The  effective  use  of  available  manpower  must  be  a  primary  consideration  In  the  selection  of 
design  options;  new  systems  must  make  effective  compromises  between  the  use  of  man  and  use  of  equipment 
to  accomplish  system  functions,  with  cost-effectiveness  as  a  major  criterion  for  choosing  between  design 
alternatives. 

The  critical  role  the  operator  plays  In  systems  effectiveness,  in  combination  with  the  fiscal  and 
manpower  constraints  discussed  above,  Indicate  the  need  for  a  new  evaluation  technique.  The  method  must 
provide  realistic  estimates  of  the  configuration's  performance,  with  operators  of  varying  ability.  Such 
Information,  when  coafclned  with  appropriate  cost  data,  will  permit  choice  among  alternative  design  con¬ 
figurations  on  the  basis  of  expected  performance  relative  to  expected  cost. 

Operator  interface  Cost  Effectiveness  Analysis  (OICEA)  represents  an  effort  to  develop  such  a  cost- 
effectiveness  prediction  methodology.  The  approach  Is  based  on  the  Human  Operator  Simulator  (HOS)  model 
(Strleb,  1975;  Wherry,  1976),  developed  for  evaluating  tystem  operability  during  early  system  design. 

The  following  sections  present  the  OICEA  methodology  and  Its  rationale,  summarize  features  of  the  HOS 
model  and  describe  two  applications  of  the  technique.  The  first  application  deals  with  the  non-acoustic 
sensor  station  operator  on  an  antisubmarine  warfare  (ASW)  patrol  aircraft;  It  compares  a  current 
system  with  several  alternate  configurations  and  demonstrates  that  OICEA  can  Identify  known  problems  and 
diagnose  their  causes.  The  second  application,  In  progress,  simulates  the  acoustic  sensor  station  opera¬ 
tors  In  an  advanced  (net  yat  operational)  version  of  the  same  ASW  aircraft.  The  simulation  models 
avionics  that  Include  a  highly  advanced  onboard  signal  processor  and  newly  developed  acoustic  sensors. 

The  goal  of  this  application  Is  to  Identify  potential  problems  prior  to  fleet  Int*- Auction  and  to  provide 
a  readily  available  mechanism  for  evaluating  and  correcting  system  deficiencies  acted  during  opera¬ 
tional  use. 


APPROACH 


Rationale 

Differing  system  configurations  that  may  vary  widely  In  their  actual  operational  effectiveness  may 
appear  to  be  virtually  Indistinguishable  during  early  development  stages.  It  Is  normally  prohibi¬ 
tively  expensive  to  develop  a  hardware  simulator  or  prototype  for  each  alternative  in  order  to  obtain  an 
estimate  of  Its  potential  worth.  Therefore,  there  Is  a  requirement  for  a  methodology  to  assist  early  In 
the  system  design  process  In  determining  the  alternatives  to  be  retained  for  development.  Digital 
computer  modeling  nas  been  a  traditional  and  typically  effective  method  for  making  forecasts  under  such 
conditions.  The  OICEA  technique  combines  digital  computer  equipment  and  operator  models  with  standard 
costing  techniques  to  obtain  data  that  enables  alternatives  to  be  compared  with  one  .mother  and  with 
existing  systems  on  the  basis  of  cost  effectiveness. 

Any  model  that  Is  to  be  used  to  perform  such  an  evaluation  must  satisfy  several  criteria; 

a  First,  it  must  be  Integrative.  It  must  be  able  to  simulate  the  hardware,  software, 
and  operator  systeFcomponants  within  a  single  conceptual  framework,  along  with  any 
external  data  sources  such  as  sensor  data  returns  and  communications. 

e  Second,  the  model  must  be  flexible;  It  must  be  able  to  accommodate  virtually  any  class 
of  manned  system  or  subsystem  and  provide  for  straightforward  modification  of  system 
characteristics  without  extensive  revisions. 

e  Third,  It  must  be  sensitive  to  relatively  subtle  differences  In  configuration  perfor¬ 
mance.  This  presupposes  a  level  of  detail  In  the  model  consistent  with  the  use  of 
task  or  subtask  level  analytic  data  for  operators  and  detailed  specifications  for  the 
equipment, 

e  Fourth,  the  model  must  be  dynamic  reallocating  Its  task  priorities  In  accordance  with 
performance  Influences  whlcn  may  be  exclusively  situation-dependent. 

e  Fifth,  the  model  must  be  parametric.  Many  of  the  quantities  which  describe  operator 
capabilities  and  performance  characteristics  of  equipment  are  not  fixed  values,  but 
can  vary  both  between  and  within  operators  and  between  and  within  hardware/software 
configurations.  Iterating  a  simulation  with  different  values  of  potential  key  parame¬ 
ters  can  help  to  determine  which  of  these  particular  parameters  are  Important  and 
which  parameter  values  provide  the  best  performance.  Varying  such  quantities  as  sen¬ 
sor  return  integration  times,  radar  detection  ranges,  and  operator  characteristics  can 
yield  valuable  information  both  about  design  and  training  questions  and  about  system 
effectiveness. 

a  Sixth,  the  model  must  be  able  to  produce  specific  Quantitative  measures  of  system  per¬ 
formance.  There  are,  for  any  system,  numerous  ways  of  deriving  numbers  which  reflect 
performance.  The  combination  of  measures  Into  a  single  global  assessment  of  perfor¬ 
mance  must  eventually  entail  obtaining  explicit  judgements  of  worth  or  utility  for 
each  of  these  effectiveness  measures.  The  model  must  enable  the  estimation  of 
separate  performance  Indices  that  are  specifically  quantifiable  and  mlsslon-rtlevant. 
Variables  such  as  time  to  perform  a  mission,  ordinance  or  stores  expended,  number  of 
correct  ship/aircraft  Identifications,  and  targets  processed  or  probable  kills  are  all 
potential  numerical  reflections  of  system  success.  While  the  measures  will  change 
from  one  system  to  another,  effectiveness  Indices  should  be  readily  obtainable  from 
routine  model  outputs. 


The  Human  Operator  Slmulator(HOS) 


KOS  Is  a  digital  computer  program  designed  to  simulate  the  complex  Interactions  between  man  and 
equipment  by  modeling  both  the  operating  characteristics  of  the  machine  and  the  perceptual,  cognitive  and 
motor  functions  of  the  operator.  HOS  Is  a  "generalized  operator."  It  becomes  a  specific  operator  In  a 
specific  situation  when  It  Is  provided  with  descriptions  of  the  equipment  to  be  used  and  the  procedures 
to  be  followed.  Procedural  Instructions  are  written  In  the  Human  Operator  Procedures  Language  (HOPROC),  a 
simplified  English-like  computer  language i  operator  transfer  functions  or  mathematical  expressions  of 
hardware  functioning  within  a  procedure  may  be  represented  In  FORTRAN,  a  subset  of  HOPROC. 


HOS  differs  from  other  models  of  operator  functioning  In  that  times  for  task  execution  are  not 
supplied  by  an  analyst  or  drawn  from  sample  time  distributions.  Instead,  HOS  generates  task  performance 
data  In  accordance  with  detailed  human  performance  micromodels  built  Into  the  HOS  system.  The  HOS 
operator  Is  capable  of  performing  seven  "primitive"  functions: 

e  obtaining  Information, 

e  remembering  Information, 

e  performing  mental  calculations, 

e  making  decisions, 

e  moving  a  body  part, 

e  manipulating  a  control , 

e  relaxing. 

Every  action  that  the  HOS  operator  performs  Is  a  combination  of  one  or  more  of  these  primitive  func¬ 
tions.  Internal  decision  rules  within  HOS  automatically  determine  the  function  combinations  that  make  up 

a  task,  'etermlne  the  sequence  In  which  tasks  aro  performed,  and  calculate  the  time  required  to  complete 
them. 


The  detailed  analysis  of  system  events  Is  performed  by  another  program,  the  Human  Uperator  Data 
Analyzer  and  Collator  (HODAC ) ,  which  provides  Information  on  operator  activities  and  equipment  status  at 
any  Instant.  In  time  during  the  simulation.  HODAC  generates  statistics  on  operator  time  usage  during  a 
mission,  'the  sequences  of  processes  executed,  the  frequency  and  total  time  spent  In  accessing  each 
control  and  display,  and  other  summary  reports. 


HOS  has  several  sophisticated  features  that  make  It  particularly  applicable  to  the  simulation  of 
complex  missions.  For  example,  the  HOS  operator  1$  goal -oriented;  that  Is,  the  operator  will  perform 
actions  necessary  to  accomplish  a  task,  but  will  omit  actions  that  have  become  unnecessary  due  to  events 
elsewhere  In  the  slmulaton.  In  addition,  formal  strategies  or  decision  rules  supplied  by  the  analyst  may 
employ  branching  logic  that  may  be  dependent  on  system  status  at  the  time  the  decision  must  be  made.  The 
task-seauencing  algorithms  In  HOS  are  dependent  on  an  original  procedure  priority  (set ‘by  the  analyst) 
modified  by  the  time  since  that  procedure  was  last  executed.  For  procedures  which  Involve  reading 
displays,  control  manipulation,  or  instrument  monitoring,  priorities  are  also  modified  by  an  "Internal 
limits’1  factor  which  specifies  the  degree  of  precision  required  for  that  operation.  Procedures  with 

small  Internal  limits  that,  must  be  executed  more  often  have  their  priorities  changed  accordingly.  Based 

on  all  these  factors,  computed  priorities  are  compared  and  the  most  critical  procedure  Is  executed. 

Parameters  describing  operator  characteristics  can  be  provided  to  the  simulation  to  vary  the  char- 
t.erlstlcs  of  the  HOS  operator.  The  default  values  of  these  parameters  are  chosen  to  represent  a  trained 
operator  with  "average"  abilities.  The  HOS  operator  will  perform  assigned  tasks  with  little  or  no  chance 
for  error  unless  that  error  Is  specifically  Introduced  and  controlled  by  the  analyst.  This  power  to 

control  the  characteristics  of  the  operator  provides  a  ready  method  of  determining  the  range  of  operator 

abilities  for  which  a  system  Is  suitable. 


HOS  has  been  used  to  simulate  a  variety  of  relatively  simple  tasks  such  as  reach  performance, 
multiple  dial  reading  and  mall  sorting  (Strleb,  1976).  It  has  been  applied  to  assessment  of  operator 
workload  In  a  dual  task  situation  (Lane,  Strleb  and  Wherry,  1977)  and  to  a  complex  operational  mission  — 
a  simulation  of  the  Air  Tactical  Officer  In  the  LAMPS  antisubmarine  helicopter  (Strleb  et  al ,  1975). 

HOS  Is  described  In  more  detail  In  Strleb,  Glenn  and  Wherry  (1978).  Useful  analyses  which  discuss  HOS 
In  the  context  of  other  operator  models  are  contained  In  Pew  et  al  (1977)  and  Greening  (1978). 

Operator  Interface  Cost  Effectiveness  Analysis 

The  approach  to  system  evaluation  described  in  this  paper  Is  not  a  new  model.  Rather  It  Is  a  way  of 
using  existing  models  to  organize  and  answer  questions  about  new  systems  or  alternative  designs.  The 
goal  Is  to  provide  the  best  possible  projections  of  the  performance  of  those  alternatives  within  the 
range  of  conditions  likely  to  be  encountered  In  fleet  use. 


Systems  are  rarely  manned  by  perfect  operators.  While  It  1*  Important  to  know  the  performance  poten¬ 
tial  of  a  system  with  an  operator  who  Is  capable  of  handling  every  conceivable  task  In  every  conceivable 
situation,  It  Is  much  more  critical  to  understand  the  probable  performance  given  a  typical  operator  with 
human  limitations  In  realistic  situations.  It  Is  not  uncommon  for  substantial  research  and  development 
costs  to  be  Invested  In  a  system  which  performs  more  poorly  than  a  system  already  In  the  fleet.  Some  new 
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systems  achieve  distinct  Improvements  In  performance,  but  only  with  an  unacceptable  level  of  operating 
and  support  costs. 

New  systems  must  be  designed  to  provide  Improved  performance  at  a  reasonable  cost.  Frequently 
however,  a  consistent  set  of  criteria  are  not  considered  when  choosing  among  the  various  available  ways 
of  Improving  system  performance.  The  objective  of  the  OICEA  approach  Is  to  make  criteria  directly 
visible  by  the  deliberate  comparison  of  alternatives  to  a  baseline  performance  level  and  a  baseline  eost. 
OICEA  is  the  systematic  application  of  digital  simulation  to  derive  performance/cost  data  as  early  as 
possible  In  the  design  cycle.  Generally,  this  Involves: 

e  simulating  a  baseline  system: 

e  simulating  one  or  more  system  alternatives: 

e  obtaining  appropriate  performance  measures  for  baseline  and  alternatives: 
e  obtaining  baseline  and  alternative  cost  data: 
e  generating  cost/benefit  tradeoffs  based  on  these  data. 

To  achieve  a  breadth  of  comparison  using  prototypes,  dynamic  simulators  or  functioning  mockups  would 
require  excessively  heavy  investments  of  time  and  dollars,  and  results  would  be  too  late  to  Impact  on 
system  selection.  OICEA  enables  performance  estimates  to  be  derived  quickly  and  Inexpensively  for  a 
variety  of  scenarios  and  tactics,  with  varlud  operator  procedures  and  system  configurations. 

INITIAL  STUDIES 


The  Intent  of  the  Initial  application  of  OICEA  methodology  was  to  determine  If  the  technique  yielded 
objective  data  of  the  type  that  might  have  led  to  system  correction  had  such  data  been  available  during 
avionics  design.  The  Sensor  Station  3  (SS-3)  crewstatlon  onboard  the  P-3C  ASH  patrol  aircraft  was 
selected  for  study.  Chronic  operator  overload  problems  were  reported  to  exist  at  this  station  during 
certain  missions.  The  operator  overload  was  a  consequence  of  requiring  the  operator  to  perform  radar 
Intercept  and  navigation  Information  tasks  while  detecting,  analyzing  and  Identifying  targets  of  military 
significance.  The  discussion  below  summarizes  the  OICEA  study  that  was  undertaken  to  Investigate  these 
problems.  Further  details  are  presented  In  Strleb  et  al  (1978),  Strleb  and  Harris  (1978)  and  Strleb 
(1979). 

Scenario 

The  SS-3  utilizes  four  non-acoustic  sensors:  radar,  forward  looking  Infra-red  (FUR),  electronic 
support  measures  (ESM),  and  magnetic  anomaly  detection  (MAD).  Three  of  the  sensorss  (radar,  FLIR  and 
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coast  of  a  potentially  hostile  nation.  The  operator's  primary  objective  was  to  confirm  the  pretence  or 
absence  of  a  specific  ship  within  the  anchorage  area  by  acquiring  ESM  data  from  a  target  matching  the 
signature  of  at  least  one  of  the  emitters  known  to  be  on  that  ship,  followed  by  visual  confirmation  and 
the  acquisition  of  pictures  of  all  contacts  not  positively  Identified  as  either  neutral  or  friendly.  The 
tactical  constraints  were: 

(a)  flight  within  a  specified  distance  of  the  coastline  was  prohibited: 

(b)  total  time  In  the  anchorage  area  was  to  be  minimized, 

(c)  a  single  direct  overflight  tactic  was  to  be  employed: 

(d)  the  aircraft  was  to  maintain  a  constant  altitude  and  speed  within  the  anchorage  area, 

(e)  vessels  not  In  the  anchorage  area  wart  to  be  Ignored  after  their  location  was 
determined. 

Figure  1  shows  the  layout  of  the  anchorage  area  with  locations  of  targets  and  emitters.  Theta  ware 
ten  surface  ships  In  the  primary  search  area  (the  square  area  shown  In  Figure  1).  Of  these,  six 
(Including  the  primary  target)  were  targets  of  Interest.  An  additional  twelve  ships  were  located  uutslue 
the  primary  search  area.  The  ships  (both  Inside  and  outside  the  area)  had  a  total  of  34  emitters  and 
them  were  ten  more  emitters  located  on-shore.  Emitters  varied  In  duty  cycle  and  In  period  of  emission. 
The  aircraft  entered  the  aren  and  flew  from  target  to  target.  In  turn,  until  all  targets  In  the  area  of 
interest  had  been  examined.  The  flight  path  minimized  time  in  the  area,  within  the  constraints  Imposed 
by  the  primary  mission  objectives. 

Configurations  and  Tactics 

Three  SS-3  configurations  have  been  used  In  the  fleet: 
e  Baseline  --  The  standard  P-3C  without  FLIR. 
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•  Baseline  +  FUR  —  The  Baseline  configuration  with  the  addition  of  a  FUR  sensor  controlled 
by  a  joystick 

e  Update  —  The  P-3C  Update  II  with  an  Infrared  Detection  System  (1RDS),  a  FUR  system  with 
an  automated  tracking  capability. 

Operator  tasks  and  tactics  vary  as  a  function  of  the  equipment  available  In  each  configuration.  The  ' 
specific  tactics  used  for  each  configuration  were  developed  with  the  assistance  of,  and  were  approved  are 
by  fleet  SS-3  operators  with  recent  experience  In  anchorage  missions.  In  general,  the  operator  tasks 
organised  Into  five  categories: 

e  Radar  tasks  —  requires  plotting  all  targets  and  providing  periodic  navigation  updates: 

e  ESM  tasks  —  requires  evaluating  and  processing  of  emitter  data  as  well  as  correlating 

bearing  lines  with  radar  contacts: 

e  FUR  —  requires  FUR  tracking,  Image  adjustments  and  recording: 

e  Mission  Planning  —  requires  target  selection  and  flight  path  control: 

e  Run-In  —  requires  performance  of  electronic  Intelligence  (FLINT)  gathering  procedures, 
target  type  determination  and  mark-on-top  procedures. 

Results  of  Analysis 

An  anchorage  mission  is  primarily  an  Intelligence  gathering  exercise,  where  the  information  to  be 
obtained  Includes  ESM  data  and  FUR  pictures,  In  addition  to  the  basic  requirement  of  Identifying  and 
locating  targets  In  the  anchorage  area.  Balanced  against  the  objective  of  maximizing  Information  was  the 
requirement  that  minimum  time  be  spent  In  the  anchorage  area.  This  leads  to  two  classes  of  performance 
measures  for  the  mission:  the  amount  of  Information  gathered,  and  the  time  to  complete  the  mission.  The 
Information  gathered  Is  measured  by  the  number  of  emitters  correctly  Identified  and,  In  those  con¬ 
figurations  with  a  FLIR  system,  the  number  of  FUR  pictures  obtained. 

Performance  —  Performance  for  each  of  the  three  system  configurations  Is  shown  In  Figure  2.  The 
comparison  of  time  and  effectiveness  for  the  three  configurations  Is  striking,  When  the  maned  FUR 
was  added  to  the  Baseline,  ESM  effectiveness  dropped  from  100  percent  to  82  percent,  none  of  the  possible 
FLIR  pictures  were  actually  acquired  and  time  Increased  by  7  percent.  Thus,  the  addition  of  FLIR  not 
only  failed  to  provide  an  enhanced  capability  as  Intended,  but  In  fact  Interfered  strongly  with  the  ESM 
tasks.  In  the  Update  configuration,  on  the  other  hand,  the  automated  FLIR  maintained  or  Improved  perfor¬ 
mance  on  all  measures,  achieving  100  percent  success  In  both  ESM  processing  and  FLIR  acquisition,  at  a 
savings  of  6  percent  In  time  over  the  Baseline.  Analysis  of  operator  activity  showed  that  the  Ineffective 
performance  in  the  Baseline  +  FLIR  configuration  was  due  primarily  to  the  characteristics  of  the 
FLIR  system.  The  slew  rate  for  the  sensor  was  too  slow  for  the  operator  to  overcome  lag  time  In  response 
to  aircraft  movement.  This  problem  could  have  been  overcome  by  a  straightforward  control  redesign  had 
the  deficiency  been  Identified  prior  to  fleet  Introduction.  The  capability  to  detect  and  diagnose 
problems  at  this  level  of  detail  from  a  simulated  mission  Indicates  a  distinct  strength  of  the  OICEA 
approach. 


Cost  --  The  OICEA  cost  analysis  for  the  SS-3  simulation  used  only  Operating  and  Support  (OftS)  costs, 
dun  "TrTTarge  to  the  difficulty  of  obtaining  accurate  data  on  research  and  development  costs  after  a 
system  becomes  operational.  The  eight  components  of  the  04S  costs  Include:  component  rework,  replenish¬ 
ment  spares,  other  operating  consumables,  petroleum,  oil  and  lubricants,  standard  depot  level  main¬ 
tenance,  engine  rework,  military  personnel,  and  Indirect  operating  costs.  04S  costs  proved  to  be 
satisfactory  for  this  demonstration,  although  It  tends  to  be  relatively  insensitive  to  configuration  dif¬ 
ferences,  since  the  major  components  are  only  slightly  affected  by  changes  in  measures  other  than  time. 


Table  1  presents  on-station  flight  time,  estimated  04$  costs  per  flight  hour,  and  the  on-station  costs 
(total  cost  to  perform  the  Initial  point  to  area  departure).  The  most  striking  feeture  Is  the  change  In 
mission  cost  from  Baseline  to  Update,  a  decrease  of  5  percent  accompanied  by  the  sharp  performance  Impro¬ 
vement  already  dascrlbed. 

Tsbla  1.  On-8tetlon  Cost  and  Data  Summary 
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Relative  Cost-Effectiveness  —  Two  factors  discussed  earlier  were  the  relative  nature  of  performance 
measures  and  the  necessity  for  establishing  a  basal  Ilia  of  current  cost-affectlvaness  against  vrfilch  pro¬ 
posed  alternative  solutions  could  be  compared.  One  of  the  objectives  of  OICEA  Is  to  provide  guidance 
to  designers  and  decision  makers  about  the  most  fruitful  lines  of  development  to  solve  a  requirement  for 


Increased  system  performance.  One  method  of  providing  this  guidance  Is  the  concept  of  "acceptance 
regions"  demonstrated  In  Figure  3.  This  figure  displays  data  from  Figures  2  and  3  and  Table  1  In  a  for¬ 
mat  which  highlights  the  relative  standings  of  the  configurations  examined.  In  order  for  a  proposed 
solution  to  be  considered,  It  should  fall  In  or  near  the  acceptance  region.  The  size  and  location  of 
this  region  will  be  governed  by  the  cost-effectiveness  of  the  current  system  and  by  other  factors,  such 
is  the  Importance  placed  on  cost  as  an  evaluation  factor.  Cost  could  be  of  decreased  weighting  In  the 
decision  process  If  the  threat  was  sufficiently  critical. 

Figure  3  deals  only  with  performance  on  ESN  processing.  A  similar  figure  could,  of  course,  be 
constructed  for  FUR  performance.  It  should  be  noted  that  the  use  of  On-station  Cost  Is  a  convenient  way 
of  Incorporating  one  performance  measure  (time)  Into  the  display  of  cost-effectiveness  for  another 
measure  (ESM).  The  figure  suggests  one  way  of  presenting  cost/ performance  information.  If  researchand 
development  costs  had  Been  available,  two  or  more  comparable  figures  would  be  required. 


Sensitivity  Analyses 

Several  of  the  characteristics  of  the  SS-3  simulation  were  modified  In  a  separate  series  of  sen¬ 
sitivity  analyses  (Strleb  and  Harris,  1978).  These  analyses  (Table  2)  sought  to  determine  the  stability 
of  the  Initial  simulation,  to  changes  In  operator  characteristics  and  to  changes  In  the  tactical 
situation.  For  the  latter  change  (Varied  Approach),  the  aircraft's  Initial  location  was  changed  so  that 
the  aircraft  entered  the  anchorage  area  from  a  different  direction.  For  the  former  change  (Slow 
Operator),  a  less  responsive  operator  exhibiting  Information  absorption  and  reaction  times  twice  as  long 
as  those  used  In  the  standard  simulation  was  modeled. 


Table  2.  Summary  of  Saniltivlty  Results 
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*  PARENTHETICAL  VALUES  REPRESENT  PERFORMANCE  MEASURES  OBTAINED  WHEN  MISSION  OBJECTIVE 
WAS  TO  OBTAIN  FUR  PICTURES  OF  ALL  TAROETS  OP  INTEREST 


Operator  Free  Time  --  The  measure  of  free  time  In  Table  Z  Is  defined  as  the  amount  of  time  during 
each  simulation  in  whfch  the  operator  was  performing  monitoring  functions  or  routine  FUR  tracking  and 
there  were  ho  . unprocessed  contacts  to  be  entered.  Thus,  "free  time”  does  not  Imply  that  the  operator  Is 
not  performing  any  ^actions,  but  rather  that  the  activities  Involved  are  the  minimum  required  to  maintain 
the  system  In  Its  desired  state. 

The  statistics  In  Table  2  for, operator  free  time  show  that  the  Update  configuration  provides  the 
operator  with  more  free  time  than  either  of  the  other  two  configurations.  The  statistic  Is  relatively 
Insensitive  to  the  Initial  location  of  the  aircraft  In  all  configurations  but  shows  a  marked  decrease  for 
the  slow  operator.  In  all  configurations,  the  slow  operator  either  Is,  or  borders  on,  being  overloaded. 
This  Indicates  the  nooil  to  Insure  that  actual  operators  meet  the  proficiency  criteria  Implied  by  the  HOS 
definition  of  a  "trained  operator." 

ESM  Utilization  —  The  ESM  processing  results  In  Table  2  can  be  aurrmarlzed  as  follows!  In  both  the 
BaseTIne  and  Update  configurations,  the  operator  Is  capable  of  keeping  pace  with  the  task.  Even  In  two 
of  the  three  baseline  plus  FUR  categories,  ha  can  keep  pace  --  but  just  barely.  This  Is  because  there 
are  sufficiently  large  distances  between  targets  to  enable  him  to  catch  up  and  because  the  operator  was 
able  to  divide  his  attention  between  the  FUR  tracking  and  ESM  processing  tasks.  Whether  an  actual 
operator  has  the  ability  to  divide  his  attention  as  efficiently  as  HOS  predicts  Is  uncertain.  What  Is 
clear  Is  that  once  the  FUR  tracking  procedures  are  Initiated,  the  operator  Is  extremely  busy  and  can 
fall  behind  i >*  the  ESM  processing  quite  easily, 

FUR  Utilization  —  There  Is  a  problem  In  determining  the  percentage  of  FUR  pictures  obtained. 
Although  the  operator  might  not  get  through  the  entire  sequence  of  adjusting  the  gain,  contrast,  bright¬ 
ness,  focus  and  polarity,  the  pictures  that  are  obtained  without  these  adjustments  may  still  be  usable. 
Therefore,  when  computing  the  percentages  shown  In  Table  2,  It  was  assumed  that  If  the  target  was  on  the 
srreen  at  the  time  the  FUR  run-in  procedures  werre  Initiated,  then  the  target  was  able  to  be  success¬ 
fully  photographed.  Even  by  this  generous  criterion,  operators  In  the  Baseline  +  FUR  configuration  were 


still  clearly  .ncapable  of  attaining  a  satisfactory  level  of  performance*  The  primary  reason  for  this 
was  that  the  slew  rate  for  the  manual  sensor  was  too  slow  for  the  operator  to  be  able  to  satisfactorily 
track  the  targets  at  the  required  ranges. 


The  SS-3  operator's  performance  might  have  Improved  had  the  pilot  been  told  to  wait  until  the  opera¬ 
tor  had  completed  the  picture-taking  operations  before  proceeding  to  the  next  target.  To  examine  this 
possibility  the  tactical  constraint  that  demanded  that  the  aircraft  spend  minimum  time  In  the  anchorage 
area  was  removed.  Aircraft  flight  dynamics  were  modified  so  that  the  aircraft  would  circle  each  target, 
until  the  operator  had  sufficient  time  to  obtain  a  satisfactory  picture  (Str1eb,1979).  Implementation  of 
these  changes  yield*  he  set  of  values  shown  In  parentheses  In  Table  2.  As  expected,  the,  number  of 
FL1R  pictures  acqulreu  Increased  to  100  percent  at  the  cost  of  significantly  Increasing  mission  time  in 
the  anchorage  area.  The  operator  free  time  was. diminished  slightly  and  an  8  percent  Increase  In  iden¬ 
tified  emitters  was  obtained. 

Utilities  and  Their  Variations 

Simulation  of  the  anchorage  mission  produced  three  measures  of  system  effectiveness  —  time,  percent 
emitters  Identified  (%E I ) ,  and  percent  FLIR  pictures  obtained  (KFP).  These  measures,  particularly  the 
latter  two,  are  mlsslon^speclflc  and  partly  dependent  on  the  specific  tactical  environment.  In  tno  ana¬ 
lysis,  they  have  been  treated  as  separate  Indices  of  performance.  It  would  be  more  desirable  when  evalu¬ 
ating  cost/performance  to  deal  with  a  single  global  measure  of  performance  which  aggregates  all  possible 
measures  of  success.  To  do  this,  It  would  be  necessary  to  specify  value  of  each  measure  In  the  total 
context  of  satisfying  mission  requirements.  These  values  are  the  utilities  associated  with  each  per¬ 
formance  measure.  Weighting  performance  measures  by  their  utilities  can"yTeld  the  desired  global  measurt. 


Obtaining  utilities  Is  not  simple.  While  a  properly  defined  mission  requirement  should  Identify 
what  performance  Is  demanded  and  what  the  associated  utilities  are  as  an  Integral  part  of  the  require¬ 
ments  statement,  such  data  are  generally  not  provided.  It  may  be  possible  In  specific  cases  to  obtain 
utility  judgments  from  policy  makers,  but  this  Is  not  a  common  practice  at  prasent. 


Another  way  to  examine  the  effect  of  utility  weighting  Is  to  compute  crossover  points  for  each 
acceptance  region.  This  is  done  by  systematically  varying  utilities  through  their  probable  ranges  and 
examining  the  changes  to  the  system  alternatives  relative  to  the  acceptance  regions.  Although 
data  from  this  study  Is  not  particularly  suited  to  such  manipulation  dut  to  the  clearcut  superiority  of 
one  version,  examples  to  Illustrate  application  of  this  concept  can  ba  glvan  for  the  three 
configurations. 

An  amplrlcal  expression  can  be  written  In  the  following  form  to  combine  the  three  measures  of  system 
performance: 

c»t 


where,  UFP  Is  the  utility  weight  selected  to  designate  the  value  of  FLIR  pictures. 


Figure  4  shows  the  effect  of  varying  UFP.  If  the  objuctlve  Is  to  minimize  0n-8tat1on  Cost  relative 
to  total  performance,  there  Is  no  combination  of  utility  weights  which  will  result  In  Update  being 
Judged  less  effective.  The  Update  configuration  Is  superior  regardless  of  the  "true"  utility.  In  ad¬ 
dition,  no  values  of  UFP  exist  for  which  performance  with  the  added  manual  FLIR  sensor  exceeds  the 
Baseline  configuration,  However,  by  changing  the  mission  objectives  and  constraints  to  give  priority 
to  obtaining  all  FLIR  pictures,  the  cost  performance  Index  can  be  raised  so  that  the  Baseline  +  FLIR 
configuration  exceeds  the  Baseline  (Manual  FLIR  Revised)  although  it  Is  still  significantly  less  than 
Update.  It  should  be  noted,  moreover  that  the  “risk11  involved  in  the  Manual  FLIR  Revised  configura¬ 
tion  Is  dramatically  higher  then  that  for  other  simulations.  Staying  on  station  to  obtain  all  the 
FLIR  pictures  Increases  time  In  the  anchorage  area  by  40  percent  over  Baseline.  If  a  hostile  condi¬ 
tion  exists,  this  Increase  could  well  be  unacceptable.  The  concept  of  risk  as  a  mission  performance 
measure  has  not  been  explicitly  considered  In  these  studies,  but  Is  Implicit  In  the  Initial  tactical 
constraints.  Risk  Is  another  measure  that  could  be  quantified,  assigned  a  utility  value,  and  con¬ 
sidered  In  tradeoff  curves  similar  to  those  In  Figure  4, 


The  particular  configurations  and  parametirs  usad  In  the  SS-3  simulations  lead  to  relatively  straight¬ 
forward  conclusions  about  configuration  value  regardless  of  utilities.  It  Is  easy  to  conceive  of 
situations  In  which  declslqns  would  not  be  so  clearcut,  The  concept  of  determining  boundaries  for  which 
decisions  on  relative  cost-effectiveness  would  be  unchanged  Is  applicable  to  virtually  any  multiple  per¬ 
formance  measure  problem. 


CURRENT  APPLICATION 

Objective 

The  SS-3  simulations  just  described  used  an  operational  weapons  system  to  Illustrate  the  potential 
value  of  the  OKEA  approach  for  evaluating  the  cost-effectiveness  of  alternative  avionics  configurations. 


An  effort  Is  currently  underway  that  will  apply  the  OICEA  methodology  to  an  advanced  avionics  system 
still  under  development.  The  objective  of  the  current  effort  Is  to  develop  a  simulation  capability  that 
will  be  available  by  the  time  the  system  Is  Initially  deployed  so  that  modifications  to  the  avionics, 
proposed  as  a  result  of  operational  experience,  can  be  evaluated  for  their  relative  cost-effectiveness 
and  Impact  on  other  mission  functions.  The  system  selected  for  this  OICEA  application  Is  an  advanced 
ecoustlc  signal  processor  being  developed  for  the  tt.S.  Navy's  P-3C  ASW  patrol  aircraft,  The  application 
focuses  on  the  acoustic  sensor  station  operators  fSS-1  and  SS-2)  on  this  platform.  It  Is  preisntsd  her* 
principally  to  Illustrate  ths  flexibility  of  OICEA  to  accommodate  extremely  sophisticated  systems  and  to 
describe  the  organized  sequence  of  steps  required  to  uie  the  technique. 

A  two  phase  effort  Is  planned.  The  first  phase  will  consist  of  thrse  simulations  with  varying  com¬ 
binations  of  current  and  advanced  signal  processors  and  sensors: 

(1)  A  simulation  In  which  ths  operator  uses  the  current  signal  processor  and  current  sensor 
systems  and 

(2)  A  simulation  In  which  the  operator  uses  the  riS  signal  processor  with  current  accoustlc 

sensors 

(3)  A  third  simulation  using  the  new  processor  and  jug  sansors. 

Inthe  second  phase  of  tha  study,  the  simulations  will  be  modified  in  accordance  with  proposed  avionics 
modifications  to  determine  the  cost-effectiveness  of  thsss  modifications  prior  to  Implementation. 

Scenario 

The  mission  to  be  simulated  In  this  demonstration  Is  an  opsn  ocaan  convoy  scrtanlng  mission.  The 
aircrew  on  the  P-3C  has  baen  tasked  with  providing  protection  for  a  convoy  consisting  of  twenty  ships. 
Each  P-3C  can  remain  on-station  for  approximately  six  hours,  during  whtch  time  tha  aircrew  deploys 
passive  acoustic  sansors  In  wsdgs-shapsd  pattsrns  ahaad  of  the  Intended  course  of  the  convoy.  Each  wedge 
contains  nlna  sensors.  At  the  time  tne  simulation  begins,  ths  sixteenth  senior  his  Just  bsan  deployed 
(Figure  E).  Two  hostile  targets  with  differing  thrast  charactsrl sties  ara  on  Intsrcept  courses  with  the 
convoy  and  ara  about  to  penatrata  tha  outermost  wedge.  Once  tha  sensor  station  oparator  has  obtalnad  con¬ 
tact  on  either  of  tha  targets,  the  tactical  coordinator  (TACCO)  may  Instruct  the  pilot  to  fly  to  the  sen¬ 
sor  maintaining  contact  In  order  to  deploy  additional  sansors  around  tit*  contact.  As  additional  contact 
Information  Is  obtalnad  and  tha  location  and  classification  of  the  targat  becomes  more  certain,. the  TACCO 
will  deploy  active  sensors  to  obtain  precis*  fixing  Information. 


The  localization  problem  Is  complicated  by  the  enemy's  evasive  capabilities  »  course  and  speed 
changes  at  random  Intervals,  as  well  as  periodic  depth  changes  that  altar  tha  anamy  positions  relative  to 
the  ocean's  thermal  layer.  Moreover,  If  the  aircrew  deploys  active  sansori,  tha  targets  can  take  addi¬ 
tional  evaslva  maneuvers,  dependant  on  their  locations  relative  to  the  locations  of  tha  active  sensors. 

Sensor  Station  Operator's  Tasks 

The  sensor  station  operators  (SS-1/2)  monitor  the  seniors  as  thay  are  duployad  and  report  any  contacts 
obtained  to  the  TACCO.  Using  the  advanced  signal  processor,  the  operators  can  monitor  many  more  sensors 
than  with  current  signal  processors,  but  can  not  continuously  monitor  all  tha  sensors  that  will  ba 
deployed  during  the  course  of  the  mission.  Therefore,  the  operators  (and  the  TACCO)  must  decide  which 
sensors  to  monitor,  when  to  monitor  each  and  what  modes  (omnidirectional  or  dlractlonal,  active  or 
passive)  to  use  for  each  tensor,  based  upon  the  characteristics  of  the  mission  at  any  particular  time. 


Data  Is  displayed  to  the  operator  as  frequency  spectra  (“grams").  The  operator  can  configure  the 
system  so  that  It  will  automatically  alert  him  If  certain  patterns  of  lines  appear  on  the  grams  indi¬ 
cating  specific  types  of  hostile  targets.  Alternatively,  the  operator  can  depend  on  his  own  ability  to 
recognize  the  target  characteristics  directly  from  the  gram  data.  Tha  systam  has  a  wide  variety  of 
electronically  Implemented  aids  to  assist  the  operator  In  reading  and  Interpreting  the  gram  data.  These 
and  a  host  of  other  functions  are  callable  from  a  keyboard  that  consists  of  approximately  100  momentary 
switches  and  20  projection  readout  switches  providing  over  190  different  system  functions.  Thus  a  major 
responsibility  of  the  sensor  station  operator  is  to  decide  how  bast  to  take  advantage  of  the  system's 
capabilities.  These  activities  and  decision  processes  ere  described  by  the  procedures  developed  as 
Inputs  to  the  OICEA/HOS  model. 

Current  Status  and  Future  Use 

At  the  present  time,  the  baseline  SS-1/2  simulation  Is  balng  developed.  Even  at  this  tarly  stage, 
some  benefits  are  apparent  from  the  OICEA  methodology  (beyond  tne  expected  benefits  for  cost- 
effectiveness  evaluation).  First,  the  analysis  has  provided  detailed  procedural  definitions  that 
describe  how  the  operator  will  use  the  system  and  tne  decisions  that  must  be  made,  While  such  proce¬ 
dures  and  decision  point-  should  be  a  natural  part  of  the  system  development  process,  they  ar*  often  not 
developed  until  late  in  the  development  cycle.  Standard  reference  sources  describe  how  Individual  system 
components  are  used,  but  nut  how  the  operator  Integrates  the  use  of  these  component  functions  to  perform 
his  Job.  OICEA  requires  the  explicit  definition  of  the  specific  decision  rules  that  an  acoustic  operator 
uses  to  decide  what  actions  to  take  In  specific  situations.  For  the  currant  simulation,  a  catalog  of 
more  than  one  hundred  key  decision  points  has  been  developed.  Such  a  catalog  has  several  possible  uses. 
First,  It  provides  the  data  needed  to  train  operators  to  optimally  utilize  tne  system.  By  modifying  the 
procedures,  one  can  examine  the  effects  of  alternative  sensor  monitoring  disciplines.  It  provides  a 
means  of  testing  alternative  tactical  strategies  that  previously  were  teiteble  only  In  hardware -based 


simulators  or  through  real-world  exercises.  It  enables  the  criteria  used  by  operators  to  Identify,  loca¬ 
lize  and  classify  targets  to  be  examined  In  detail.  It  provides  a  method  by  which  operator  decisions, 
decision  situations,  and  decision  processes  can  be  Identified  --  a  capability  which  will  be  Increasingly 
Important  as  It  becomes  more  feasible  t,o  Incorporate  decision-aiding  algorithms  Into  operational  avionics 
systems.  Thus  OICEA  can  help  to  pinpoint  where  decision-aiding  systems  would  be  most  valuable;  It  can 
•Indicate  what  the  parameters  of  the  decision  situation  art  and  how  they  Interact;  and  It  can  be  used  to 
evaluate  what  performance  Improvements  one  could  expect  from  the  use  of  specific  decision  aids. 


The  Role  and  Value  of  Models 

The  current  SS-1/2  simulations  are  designed  to  Illustrate  the  Important  role  which  can  be  played  by 
system  cost-effectiveness  modeling  In  the  total  cycle  of  system  development,  modification  and  update. 
Complete  system  models  must  be  developed  concurrently  with  the  system  Itself,  maintained  and  kept  current 
as  the  system  evolves  to  operational  deployment  and  beyond.  Although  dynamic  hardware  simulators  of 
systems  will  normally  be  available  for  use  In  evaluation  toward  the  end  of  the  development  cycle,  these 
are  extremely  expensive  to  build  and  modify  and  are  not  always  kept  In  a  ready  status  after  the  system 
has  been  deployed  for  a  number  of  years.  The  evaluation  of  modifications  to  operational  systems  can 
frequently  not  be  performed  on  an  up-to-date  mission  simulator  without  extensive  Investment  and  time 
delay.  It  Is  thus  critical  that  computer  models  of  systems  be  ready  prior  to  operational  deployment  and 
regularly  modified  to  provide  Inmedlate  availability  when  a  proposed  system  update  must  be  evaluated. 


CONCLUSIONS  AND  IMPLICATIONS 


The  work  described  In  this  paper  was  Initiated  In  response  to  the  observation  that  avionics 
modifications  and  updates,  Introduced  to  Improve  total  system  performance,  frequently  had  little  effect 
or  even  adverse  impact  on  that  performance.  The  SS-3  FUR  problem  serves  at  a  classic  example  of  such  a 
problem.  The  objective  of  the  Initial  study  was  to  determine  If  the  OICEA  approach  would  predict  such 
performance  decrements  and  uneconomical  configurations.  This  objective  was  clearly  achieved,  although 
substantial  development  Is  still  required,  particularly  In  tha  costing  area. 


These  conclusions  and  the  accuracy  of  the  simulation!' themselves  were  substantiated  by  fleet  reports 
on  problems  experienced  by  SS-3  operators,  who  have  great  difficulty  In  performing  manual  FUR  tracking 
and  ESM  processing  simultaneously.  Standard  practice  was  for  another  operator  to  usa  a  folding  chair  at 
the  SS-3  console  to  assist  during  key  mission  phases.  Th.1s  difficulty  and  Its  root  causas  ware  readily 
Identified  by  the  simulation.  Had  the  OICEA  technique  bean  available  and  properly  utilized  for  evaluating 
alternate  FLIR  systems,  a  system  would  have  bean  Identified  that  would  have  accomplished  the  desired 
results  and  the  development  and  deploymant  of  an  unacceptable  configuration  could  have  been  prevented. 

Computer  modeling  of  baseline  systems  followed  by  modeling  of  proposed  changes  Is  highly  effactlve  as 
an  Initial  step  In  system  modification  and  Is  a  rapid  and  low  cost  technique  compared  to  hardware 
approaches.  It  Is  critical  In  using  this  approach  that  a  computer  model  with  both  a  realistic  avionics 
and  an  operator  component  be  available  at  or  before  fleet  deployment  of  the  system.  Tha  acoustic  sansor 
operator  simulations  currently  under  development  are  an  attempt  to  satisfy  that  requirement  for  the  P-3C 
Update  III,  a  system  with  highly  complex  avionics.  Whether  or  not  the  model  can  achleva  satisfactory 
simulation  must  still  be  determined.  If  the  effort  Is  successful,  the  potential  for  savings  In  develop¬ 
ment  and  deployment  costs  and  for  Improvements  In  system  performance  Is  enormous. 

A  second  encouraging  finding  concerns  the  ease  with  which  the  HOS  procedural  language  can  be  used  to 
systematically  vary  mission  and  equipment  parameters  and  operator  characteristics  and  decision  processes. 
Such  parameter  manipulation  allows  the  determination  of  the  robustness  of  the  simulation  outputs  to 
Idiosyncrasies  of  particular  parameter  combinations,  and  provides  Identification  of  specific  equipment  or 
procedure  characteristics  which  render  the  configuration  Ineffective.  For  the  SS-3,  relatively  minor 
changes  In  design  of  the  FLIP  control  and  relocation  of  some  displays  would  likely  have  Improved  perfor¬ 
mance  sufficiently  for  the  manual  configuration  to  serve  as  an  acceptable  Interim  alternative  to  the 
automated  system,  Thh  OICEA  approach  would  have  allowed  the  Identification  and  evaluation  of  these 
changes  at  very  low  cost. 

The  rationale  for  OICEA  Is  to  determine  whether  specific  cost  and  performance  questions  which  should 
be  raised  about  all  avionics  modifications  In  manned  systems  could  be  answered  through  the  use  of  com¬ 
puter  models  with  a  realistic  human  operator  component.  Our  results,  at  least  for  the  mission  and  con¬ 
figurations  considered  In  these  studies,  clearly  support  this  approach  to  system  design. 
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Fig, 3  Relative  cost  effectiveness  analysis 


Fig, 4  Utility-based  cost-effectiveness  tradeoff 
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SUMMARY 


The  moat  difficult  piloting  tasks  encountered  in  veriiaal/short 
take-off  and  landing  (VSTOL)  aircraft  are  the  transition  from  asro- 
dynamiaalty  supported  flight  to  thrust  supported  flight,  and  the  sub¬ 
sequent  recovery  aboard  a  ship  or  unprepared  forward  site.  A  significant 
portion  of  the  difficulty  experienced  in  these  piloting  tasks  is  due  to 
the  foot  that  out-of-the  oookpit  visibility  in  past  and  current  VSTOL 
designs  has  generally  been  too  restricted  to  provide  adequate  visual 
cues,  Aircraft  designers  have  had  difficulty  in  treating  field  of  view 
problems  since  neither  dear  criteria  nor  standard  procedures  exist  for 
dstsmining  required  outside  visibility  for  this  olaes  of  aircraft. 

In  response  to  this  defioienay,  this  paper  develops  a  rationale 
for  quantitatively  determining  fixed-wing  VSTOL  field  of  view  require¬ 
ments,  It  provides  a  relevant  predictive  and  evaluative  toot  which 
models  the  complex  interaction  between  human  visual  proceeseu,  the 
vehiola  approach  profile,  and  the  operator  flight  path  control  per¬ 
formance,  The  model  ic  intended  to  coup  lament  ana  support  av-onio 
system  and  arewatation  daaign  models.  Applied  to  the  development  of 
a  new  air  weapons  system,  this  technique  significantly  af feats  avionic 
and  airframe  design,  The  model  specifies  precise  visual  requirements 
for  recovery  aboard  defined  shipboard  pads  or  forward  cites ,  Those 
visual  requirements  which  cannot  be  satisfied  by  pilot  tasking  or 
canopy /window  considerations  must  be  fulfilled  by  innovative  avionics 
and  display  concepts, 


INTRODUCTION 

The  most  difficult  piloting  tasks  encountered  in  vertical/short  take-off  and 
landing  (VSTOL)  aircraft  are  the  transition  from  serodynamically  supported  flight 
to  thrust  supported  flight,  and  the  subsequent  recovery  aboard  a  small  ship  or  un¬ 
prepared  forward  site,  A  significant  portion  of  the  difficulty  experienced  in  these 
piloting  tasks  is  due  to  the  fact  that  out-of-the  cockpit  visibility  in  past  and 
current  VSTOL  designs  has  generally  been  too  restricted  to  provide  adequate  visual 
cues.  Aircraft  designers  have  had  difficulty  in  treating  field  of  view  problems  sines 
neither  clear  criteria  nor  standard  procedures  exist  for  determining  required  outside 
visibility  for  this  class  of  aircraft,  The  simple  solution  oi  raising  the  pilot's 
seating  position  creates  immediate  problems  with  control  reach  and  actuation.  The 
proper  solution  requires  consideration  of  pilot  visual  requirements,  airframe/ canopy 
design,  avionics  design,  and  crew  station  design. 

OBJECTIVE 

The  objective  of  this  study  was  to  develop  the  rationale  and  methodology  for 
quantitatively  determining  fixed  wing  VSTOL  field  of  view  requirements.  There  have 
been  some  rudimentary  efforts  in  the  past  addressing  this  issue,  but  most  of  the 
attnmpcs  have  considered  only  aim  point  visibility  relative  to  the  approach  path  angle 
and  vehicle  pitch  attitude.  That  is,  the  efforts'were  usually  simplistic  geometric 
exercises.  Generally  missing  from  these  models  wsb  an  appreciation  of  the  inter¬ 
relationships  among  such  parameters  as  nominal  approach  profile,  pilot's  flight  control 
precision  .n  the  face  of  environmental  disturbances,  visibility,  and  guidance  and  con¬ 
trol  cuea  (such  as  visual  landing  aids)  afforded  by  the  landing  site, 
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The  present  study,  on  the  other  hand,  combines  the  dynamic  modeling  of  (a)  the 
recovery  guidance  and  control  situation,  (b)  the  disturbance  environment,  (c)  the 
augmented  aircraft,  (d)  the  pilot's  .multiloop  control  activities,  (e)  the  perceptual 
behavior  of  the  pilot,  and  (f)  the  resulting  geometric  properties  of  information 
elements  within  the  visual  field.  These  factors  are.  combined  through  the  use  of 
closed" loop  pilot-vehicle  analysis  employing  validated  models  of  humsn  pilot  behavior. 

Using  this  technique,  the  analyst  it  able  to  establish  the  essential  Information 
elements  in  advance  of  simulation  and  to  establish  those  visual  cues  which  provide 
the  pilot  with  the  best  sensitivity  to  vehicle  motions  during  the  recovery.  The 
analyst  can  then  use  the  results  of  this  method,  in  combination  with  misalon,  vehicle, 
shipboard  and  environmental  constraints  to  suggest  optimum  aircraft  field  of  view 
requirements . 

PROCEDURE 


/  'K ,  ), 


'  IV  . 


The  methodology  developed  by  this  study  can  be  conceptually  partitionad  into  four 
clearly  defined  steps,  tn  the  interests  of  brevity,  the  four  steps  can  be  dlecuesed  in 
outline  form  only.  As  always,  the  quality  of  any  final  product  can  be  no  better  than 
the  quality  of  its  composite  supporting  framework.  The  analytic  efforts  comprising 
the  framework  in  thle  study  are  quite  rigorous,  The  numerous  references  provide 
sufficient  detail  for  the  serious  reader  interested  in  specific  assumptions  and  analy¬ 
tic  techniques  amployed  within  sach  stap. 

I,  Kinematic  Repraaantation  of  Aircraft  Approach  Trajectories 

The  first  step  in  the  procedure  is  to  select  and  define  intended  approach  tra- 
jectory(les)  of  the  aircraft  with  respect  to  the  recovery  area  on  a  moving  ship  or 
ahore  based  site.  This  requires  determination  of  the  sequence  of  nominal  operating 
points  (range,  bearing,  and  altitude  with  respect  to  the  terminal  hovering  point  over 
the  ped)  as  a  function  of  time.  The  analyst  may  also  specify  ahip  velocity,  if  appro¬ 
priate,  desired  type  of  approach  trajectory,  deceleration  and  torminal  hovering  coor¬ 
dinates  , 


II.  Pilot/Vehicle  Performance 

The  next  step  requires  exercising  an  analytic  model  of  the  pilot-vehicle  combina¬ 
tion  executing  the  intended  approach  trajectory  under  the  influence  of  turbulence, 
ship  motion,  degraded  visibility,  and  pilot  variability.  The  results  of  this  step  ere 
mathematical  relationships  among  trajectory  variables,  ship  motions,  turbulence,  and 
piloting  noise  on  one  hand  and  the  resulting  angular  and  translational  kinematics  of  • 
the  aircraft  on  the  other. 


lit.  Visual  Element  Motion  Analysis 

Having  established  one  or  more  VSTOL  approach  geometries  to  the  landing  pad 
(Stap  I) .  and  having  defined  the  performance  of  the  pilot-vehicle  combination  during 
the  critical  transition  and  hovering  phases  (Stap  XI) ,  it  is  necessary  to  interpret 
the  pilot's  perceptions  of  the  external  visual  cues  upon  which  he  relies.  For  the 
purposes  of  this  study,  the  representative  visual  cues  selected  were  most  elementary; 
the  deck  pad  and  hangar  delineation  for  a  small  Naval  destroyer  (DD  963  class) .  The 
ship  class  selected  has  a  nominal  AO  ft.  by  60  ft.  recovery  area  and  a  40  ft.  wide 
by  20  ft.  high  hangar  face,  The  analyses  conducted  in  this  study  were  directed  town  d 
determining  the  required  viewing  angleo  to  maintain  visual  contact  with  theBe  ship¬ 
board  elements.  Certainly  other  recovery  aids  or  landing  area  geometry  could  be 
examined  and  numerous  options  are  available  in  Ref.  1. 

tV.  Field  of  View  Requirements 

Combining  the  nominal  angular  motions  and  positions  of  the  visual  cue  referrenta 
from  Step  lit  with  the  previously  determined  estimates  of  variability  (due  to  distur¬ 
bances)  allows  the  analyst  to  define  explicitly  the  location  of  essential  visual  cues 
for  guidance  and  control  of  the  aircraft  within  the  pilot's  forward  visual  hemisphere. 
Field  of  view  requirements  can  be  established  utilizing  this  information  in  combina¬ 
tion  with  related  information  concerning  canopy  design,  airframe  obstructions,  and 
optical  or  electro-mechanical  landing  displays , 

TECHNIQUE  APPLICATION 

Five  representative  decelerating  trajectories  were  examined  during  the  develop¬ 
ment  of  the  methodology,  Included  in  the  sample  werei 

•  A  homing  or  pursuit  trajectory  in  which  the  aircraft  flight  path  vector 
is  always  pointed  toward  the  ship . 

•  A  coll is  lor  trajectory  which  follows  a  straight  line  path  in  the  earth 
reference  frame  toward  a  predetermined  intercept  point  with  the  ship. 
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•  A  trajectory  which  maintains  a  constant  bearing  with  respect  to  the 
ship  (such  as  a  conventional  approach  using  fixed  line  up  and  glide 
slope  angle*). 

«  A  constant  sink  rate  trajectory  (at  constant  horizontal  bearing)  where 
deceleration  along  the  earth  X-axls  is  constant. 

s  A  constant  altitude  trajectory  (at  constant  horizontal  bearing)  where 
deceleration  along  the  earth  X-axis  is  constant. 

Figure  1  depicts  graphically  the  five  vertical  plane  trajectories  and  three 
horizontal  plane  trajectories  in  the  ship's  frame  of  reference.  There  are  only  three 
trajectories  present  in  the  horizontal  plane  since  the  constant  sink  rate  and  constant 
altitude  trajectories  coincide  with  the  constant  bearing  trajectory  in  the  horizontal. 
The  ship  is  underway  at  20  kt  on  a  fixed  course  in  calm  air.  Thus  the  forward  motion 
of  tha  ship  is  generating  the  relative  wind-over-deck  (WOD)  of  20  kt  along  the  ship's 
centerline.  (Subsequently  we  shall  estimate  the  disturbing  effects  of  the  ship's 
motion  and  air  wake  turbulence  in  sea  state  5  with  43  kt  WOD.)  Bach  trajectory  ter¬ 
minates  at  40  ft  deck  height  directly  over  the  center  of  the  recovery  circle.  The 
termination  of  the  homing  trajectory  la  aligned  with  the  WOD  and  coincides  with  the 
constant  altitude  trajectory  by  design  without  special  maneuvers,  but  the  missed 
approach  route  is  blocked  by  the  aft  mast  and  stack.  Both  the  straight  line  (in  the 
earth  raferanca  frama)  and  tbj  constant  sink  rata  trajectories  require  special  ter¬ 
minal  maneuvers  to  arrest  the  descent  and  to  match  the  ship's  velocity.  The  constant 
bearing  trajectory  (in  the  ship's  reference  frame)  is  compatible  with  existing  visual 
landing  aids  on  the  ship,  Maneuvering  requirements  for  the  homing  and  constant  bear¬ 
ing  trajectories  are  discussed  In  Ref,  2. 

As  previously  stated,  Step  I  of  the  methodology  requires  the  time  dependent 
determination  of  the  sequence  of  operating  points  (range,  bearing,  and  altitude)  with 
respecc  to  the  terminnl  hovering  point,  The  details  of  the  clmned  loop  analyses  con¬ 
ducted  to  determine  the  trajectories  are  beyond  the  scope  of  this  paper  but  are  clearly 
presented  in  Ref.  3.  Tables  1  and  2,  however,  present  s  qualitative  summary  of  the 
relative  advantages  and  disadvantages  of  the  selected  trajectories.  Although  it  was  not 


TABLE  1 

TRAJECTORY  COMPARISONS  -  HORIZONTAL  PLANE 


CONSIDERATION 

HOMING 

CONSTANT  BEARING 
(INERTIAL  AX.ES) 

CONSTANT  BEARING 
(SHIP  AXES) 

STRAIGHT  PATH 

Ship-to-aircraft 

surveillance 

Large  changes  in 
bearing  angles 

Small  changes  in 
bearing  angle  un¬ 
less  snip  turns 

Constant  bearing 
angle 

Large  changes 
in  bearing 
angle 

Air craft -to- ship 
visibility 

Good,  aircraft 
always  pointed 
at  ship 

Fair,  moderate 
change  in  bearing 
angle,  may  re¬ 
quire  wing- low 
tor  visibility 

Fair,  moderate 
change  in  bear¬ 
ing  angle,  may 
require  wing-low 
for  visibility 

Poor,  large 
variation  in 
bearing  angle, 
may  require 
wing- low  for 
visibility 

Landing  pad 
perspective 

Modest  changes 

Small  change  un¬ 
less  ship  maneu¬ 
vers 

No  change 

Larger  changes 
than  homing 
trajectory 

Aircraft 

maneuvering 

Moderate  lateral 
g  at  short  range 

Low  lateral  g 

Low  lateral  g 
unless  ship 
turns 

None  until 
terminal  ma¬ 
neuver  unless 
ship  maneuvers 

Bolter  and 

obstacle 

avoidance 

Fair,  on  colli¬ 
sion  course 
from  astern 

Good,  approach 
from  side,  on 
collision  course 
only  if  stop 
decelerating 

Good  approach 
from  side,  on 
collision  course 
only  if  stop 
decelerating 

Fair,  approach 
from  side,  on 
collision 
course  if  main¬ 
tain  decelera¬ 
tion  schedule 
(unless  bias 
aim  point) 

an  objective  of  this  study  to  select  a  beBt  or  most  desirable  trajectory,  it  is  read¬ 
ily  apparent  from  Tables  1  and  2  that  certain  trajectories  possess  more  advantages 
than  others.  The  field  of  view  requirements  necessary  to  maintain  visual  contact  with 
the  deck  pad  and  hangar  face  (from  700  ft.  range  to  the  hover  point),  however,  have 
been  computed  for  all  approach  trajectories, 


TABLE  2 

TRAJECTORY  COMPARISONS  -  HORIZONTAL  PLANE 


CONSIDERATION 

HOMING 

CONSTANT  BEARING 
(INERTIAL  AXES) 

CONSTANT  BEARING 
(SHIP  AXES) 

STRAIGHT  PATH 

Guidance  data 
requirements 

LOS  relative 
to  aircraft 
haading 

Angular  velocity 
of  LOS 

Deviation  from 
ship-fixed  beam 

Ship  and  aircraft 
positions  (iner- 
tial  axes) 

Guidance  hard¬ 
ware 

Aircraft  can 
track  passive 
ship 

Aircraft  can 
track  passive 
ship  but  need  to 
derive  angular 
rate  of  LOS 

Ship  transmits 
refsrence  beam; 
or  trecka  air¬ 
craft  and  trana- 
mits  commands/ 
data 

Aircraft  can 
track  pasalva 
ship  but  nsed 
higher  precision 
for  ship  pre¬ 
diction 

Compatibility 
with  VLA'e 

Good  at  short 
range;  always 
approach  from 
astern 

Fair,  approach 
angle  varies 
slightly  if  ship 
does  not  turn, 
can  vary  grsatly 
if  ship  turns 

Excsllsnt, 
approach  angla 
is  constant 

Fair,  requires 
modest  turn  on  to 
VLA  unless  ship 
maneuvers 

Effects  of  ship 
manauvering 

Slight 

Slight 

Slight  for  spaad 
changes .  Largs 
for  turns i  may 
be  impossible  to 
follow  at  long 
range 

Modest  aircraft 
maneuvering  re¬ 
quired  but  compli¬ 
cates  ship  pre¬ 
diction 

Ones  tha  approach  trajectories  have  been  mathematically  represented,  we  may  move 
on  to  consideration  of  the  pilot's  view  from  each  nominal  trajectory  in  the  absence  of 
aircraft  perturbations,  The  perspective  view  of  the  recovery  deck  of  a  DD-963  class 
destroyer  is  depicted  for  each  of  the  five  trajectories  in  Figures  2  through  6.  The 
perspective  views  begin  with  the  minimum  assumed  visual  detection  range  of  700  ft 
and  end  with  the  pilot's  aye  40  ft  above  the  center  of  the  recovery  circle,  The  illus¬ 
trations  assume  that  tha  pilot  is  looking  at  the  center  of  the  recovery  circle,  which 
appears  elliptical  in  perspective;  tha  figures  omit,  for  the  time  being,  the  obscuring 
effect  of  any  cockpit  structure.  The  origin  of  the  horizontal  viewing  angle  (\)  axis 
corresponds  to  the  horizontal  reference  line  of  sight  relative  to  the  nose  of  the  air¬ 
craft  at  each  value  of  slant  range,  Rj,;  thus  the  centers  of  the  landing  pads  appear  to 
be  in  the  same  horizontal  line  of  3ignt  for  the  homing  and  constant  bearing  trajector¬ 
ies,  but  not  for  the  straight  line  trajectory':  The  origin  of  the  vertical  viewing 
angle  (y)  axis  corresponds  to  the  vertical  line  of  sight;  thus  the  centers  of  the 
landing  pads  reflect  the  depressed  elevation  angles  (LOS  )  relative  to  the  horizon 
at  each  slant  range,  R^.  v 

As  long  as  the  aircraft  (pitch  3nd  roll)  attitude  is  approximately  level,  field 
of  viev:  requirements  for  the  nominal  unperturbed  approach  trajectories  may  be  inter¬ 
preted  directly  in  terms  of  the  angles  \  and  y  +  LOS  for  all  trajectories  except  the 
straight  line  (in  inertial  space) ,  for  which  the  horizontal  field  of  view  require¬ 
ment  must  be  interpreted  in  terms  of  A  +  . 

Figures  7  and  8  are  projections  of  the  landing  pad  and  hangar  face,  respectively, 
when  the  aircraft  has  reached  the  hover  point  40  ft  over  the  center  of  the  pad  (R  ■  0) . 
In  Figure  7,  the  pilot  is  assumed  to  be  looking  at  the  center  of  the  recovery  circle 
which  is,  of  course,  at  the  nadir,  but  in  Figure  8,  his  line  of  sight  (LOS)  is  shifted 
to  the  upper  center  of  the  hangar  face.  Even  that  line  of  sight  in  depressed  over 
33  deg  from  the  horizontal  plane. 

Having  examined  pictorially  and  graphically  the  undisturbed  case,  the  more  real¬ 
istic  case  which  takes  into  account  aircraft  perturbations  resulting  from  environmental 
and  pilot  control  factors  may  be  considered,  It  is  readily  apparent  from  previous 
figures  that  field  of  view  requirements  will  be  greatest  near  the  ship  in  hovering  and 
near-hovering  flight,  Therefore,  Figures  9  and  10  illustrate  the  combined  effocts  of 
rotational  and  translational  disturbances  in  the  controlled  aircraft  motion  on  thesa 
hovering  and  near-hovering  field  of  view  requirements.  The  details  of  the  extensive 
analyses  required  to  provide  the  present  examples  are  documented  in  Refa,  4  and  5  end 
will  not  he  repeated  here.  The  results  depend  in  a  critical  way  on  the  selected 
model  of  the  snip's  airwake  disturbance  environment,  The  two  example*  of  perturbed 
field  of  view  requirements  include;  (1)  from  50  f t  range-to-go  (t:o  the  hovering  point) 


on  a  constant  relative  bearing  trajectory  and  (2)  from  the  hovering  point  itself  40  ft 
above  the  center  of  the  deck.  For  oeleeted  points  of  regard  by  the  pilot,  we  can 
estimate  Gaussian  statistical  variances  in  the  required  field  of  view  caused  by  the 
predicted  variances  in  the  six  aircraft  degrees  of  freedom  listed  in  Table  3,  Corres- 

TABLE  3 


SUMMARY  OF  ILLUSTRATIVE  MOTION  ERROR  VARIANCES 
FOR  USE  IN  EXAMINING  HOVERING  FIELD  OF  VIEW  REQUIREMENTS 


Sea  State  5 

Wind-Ovtr-Dtck  -  43  kt 

Ship  Speed,  Va  -  20  kt 

Clockwise  Wave  Direction  Relative  to  Ship's  Stern,  y  - 

120  deg 

Mean-Squared  Ship  Motions  at  the 

Mean-Square  Aircraft  Motion 

Csntsr  of  the  Lending  Pad 

Relative  to  Ship  while 

(Relative  to  Inertial 

Space)  for  the  DD963 

Station-keeping  under  Manual  Control 

Ship 

Motion 

Variance 

Aircraft 

Motion 

Variance 

Roll  c? 

(2.02  deg) 11 

Roll  p4 

(2.5  deg)4 

Pitch  Og 

(0.77  deg)a 

Pitch  crj 

(3.0  deg)4 

Yaw  o* 

(0.30  deg) 4 

Yaw  o4 

(2.1  deg) 4 

Surge  c£ 

(0.40  ft)4 

Surge 

(11,6  ft)4 

Swey  c4 

(2.05  ft)4 

Sway  Qy 

(15.5  ft)4 

Heave  a* 

(2.71  ft)4 

Heave  o4 

(19.5  ft)2 

ponding  distributions  of  perturbations  in  terms  of  viewing  angles  will,  however,  tend 
to  be  increasingly  skewed  as  the  point  of  regard  departs  from  the  nominal  line  of 
sight  (the  optical  axis  of  the  picture  plane;,  because  of  the  tangent  relationship 
between  picture  plane  coordinates  and  viewing  ttnglea.  Nevertheless,  we  can  approximate 
the  root- sum-squared  angular  variance  for  the  pilot's  nominal  lina  of  sight  to  the 
center  of  the  recovery  circle  by  the  large  ellipse  in  Figure  9  at  50  ft  range-to-go 
to  station-keeping.  The  root -sum- squared  variance  for  the  pilot's  nominal  line  of 
sight  to  the  upper  center  of  the  hangar  face  is  shown  by  the  large  ellipse  in  Figure  10 
while  the  pilot  is  attempting  to  keep  on  station  over  the  deck.  These  extreme  esti¬ 
mates  of  variability  confirm  the  desirability,  from  the  standpoint  of  reducing  field 
of  view  requirements,  of  providing  visual  cues  and  visual  aids  above  the  hangar  for 
assisting  the  pilot  in  arresting  and  approach  and  providing  hovering  guidance. 

These  extreme  estimates  of  variability  also  emphasize  the  need  for  high  authority, 
high  bandwidth  flight  control  systems  in  order  to  function  affectively  in  this  environ¬ 
ment  --  much  higher  than  is  typical  of  current  helicopter  practice,  The  allowable 
aircraft  motions  duu  to  all  causes  are  only  a  few  feet  --  Ref.  6  states  "3  to  4  ft"  in 
"allowable"  touchdown  error.  If  we  interpret  "allowable"  as  2c,  Table  3  shows  that 
the  square  root  of  the  sum  of  the  x-  and  y-variances  in  deck  motion  alone  at  the 
center  of  the  pad  slightly  exceeds  this  "allowable"  touchdown  error.  Without  chasing 
the  deck,  this  allowable  touchdown  error  thus  represents  the  best  precision  one  might 
expect  from  a  guidance  «nd  control  system  which  regulates  so  well  that  no  errors  are 
contributed  by  aerodynamic  disturbances  or  the  pilot's  divided  attention.  Graphic 
representation  from  the  pilot's  station-keeping  perspective  of  this  apparent  c-varia- 
tion  in  the  center  of  the  pad  due  to  ship  motion  alone  is  shown  by  the  smallest  cen¬ 
tral  o-ellipse  at  50  ft  range-to-go  in  Figure  9  and  at  zero  range-to-go  in  Figure  10. 

With  this  assessment  of  the  variability  in  the  viewing  angles  required  of  the 
pilot  with  respect  to  his  cockpit  reference,  ws  conclude  our  analyses  of  field  of  view 
requirements  in  the  extremely  severe  disturbance  environment  to  be  expected  in  sea 
state  5  with  43  kt  wind-over-deck,  The  predicted  field  of  view  requirements  with 
manual  control  appear  to  be  bo  great  that  more  confidence  is  needed  in  the  validity 
of  the  predicted  alrwake  disturbance  environment  on  which  this  analysis  is  predicated 
before  these  expectations  can  be  converted  into  design  requirements  for  field  of  view, 
which  are,  in  turn,  based  on  high  authority,  high  bandwidth  flight  control  systems. 


DISCUSSIONS 


It  would  be  presumptlous  for  the  authors  to  Infer  that  the  resultant  methodology 
can,  by  itself,  produce  discrete  values  which  precisely  define  the  field  of  view 
requirements  for  the  VSTOL  pilot.  The  present  technique  is  definitive  in  determining 
field  of  view  requirements  when  visual  contact  must  be  maintained  with  any  predefined 
point  on  the  ship  or  land  based  site.  It  beers  emphasizing,  however,  that  field  of 
view  requirements,  per  se,  depend  upon  numerous  factors  including  but  certainly  not 
limited  to: 


e  approach  trajectory 
e  perceptual  cues  available  to  the  pilot 
e  vehicle  handling  qualities 

e  vehicle  airframe/ canopy/ crews tetion  characteristics 
e  display  system  capabilities 
e  environmental  characteristics 
e  shipboard  or  aircraft  visual  landing  aids 

While  the  present  methodology  takes  into  account  more  of  the  above  factors  than 
previous  work  conducted  in  this  area,  it  is  most  beneficially  used  in  conjunction  with 
other  engineering  factors  in  deciding  upon  field  of  view  requirements . 

Consider,  for  example,  a  hypothetical  case  where  for  either  operational  or  policy 
constraints  a  constant  sink  rate  trajectory  at  constant  hearing  must  be  utilized. 

Using  the  methodology  developed  in  this  paper,  it  can  be  determined  that  the  pilot 
will  require  almost  68  ovar-the-nose  visibility  to  maintain  visual  contact  with  the 
center  of  the  landing  pad  when  he  is  located  50  ft  from  the  hover  point,  and  that 
figure  assumes  the  absence  of  any  environmental  disturbances.  In  a  situation  such  as 
this,  tha  field  of  view  methodology  does  not  truly  provide  requirements  but  serves 
as  a  design  tool  in  that  it  alerts  engineers  to  the  need  for  possibly  greatly  sophis¬ 
ticated  displays  or  an  automatic  landing  ayatam.  If  these  solutions  are  impractical 
or  unfeasible  then  perhaps  operations  and  systems  analysts  can  reexamine  tha  nead 
for  a  constant  sink  rata  trajectory,  In  this  respect,  it  la  apparent  that  this 
methodology  can  rightfully  ba  considered  a  design  tool.  It  can  be  extremely  useful 
when  input  parameters  to  the  models  such  as  approach  parameters  or  environmental  dis¬ 
turbances  are  varied  systematically  while  the  model  is  exercised  repeatedly. 

This  methodology  for  determining  field  of  view  also  has  secondary  implications  for 
design  engineers  working  in  tha  areas  of  head  up  displays  (HUD) ,  conventional  instru¬ 
mentation,  automatic  guidance  and  landing  systems,  in  addition  to  human  operator  model¬ 
ers.  HUD  dauignars,  for  example,  must  be  aware  of  where  the  pilot  is  looking  for 
visual  cuss  in  order  to  avoid  cluttering  thoBa  regions  with  excess  symbology.  Addi¬ 
tionally,  the  HUD  designer  must  consider  the  possible  field  of  view  benefits  of  a 
wide  angle  head  up  display  traded  off  against  wide  angle  displays  technical  problems. 

Conventional  crewstation  design  angineers  must  be  concerned  with  field  of  view 
implications  in  that  one  of  the  most  obvious  methods  of  increasing  over  the  nose 
visibility  in  any  aircraft  is  reducing  the  height  of  the  Instrument  panel  and  glare 
shield.  If  this  became  a  viable  alternative,  then  crewstation  designers  may  be  forced 
to  wrestle  with  such  issues  as  removal  of  the  control  column,  elimination  or  miniatur¬ 
ization  of  instruments  or  possibly  a  "swing  away"  instrument  panel,  It  goes  without 
saying,  of  course,  that  if  these  more  exotic  alternatives  cannot  be  accommodated  then 
the  crewstation  designer  must  direct  his  energies  to  radically  improved  display 
design.  Conventional  instrument  panel  or  horizontal  displays  may  prove  adequate 
if  the  information  integration,  format,  accuracy,  and  sensitivity  are  superior  to 
that  presently  available, 

The  relationship  between  automatic  guidance  and  landing  and  field  of  view  require¬ 
ments  is  a  subtle  one  but  nevertheless  valid,  All  automatic  guidance  and  landing  sys¬ 
tems  must  have  a  manual  override  to  enable  the  pilot  to  take  control  If  and  when  he 
deems  necessary.  Regardless  of  the  technical  complexity  and  capability  of  the  system 
it  will  not  be  effectively  utilized  if  the  pilot  has  little  confidence  in  it,  Undoubt¬ 
edly,  the  pilot  will  be  closely  monitoring  the  outside  visual  scene,  checking  the  rela¬ 
tive  positions  and  motions  of  the  aircraft  and  the  ship  anticipating  the  possibility  of 
manual  override.  If  the  pilot  does  not  see  visually  something  which  seems  familiar 
and  confortable,  he  will  take  control  of  the  situation  very  quickly,  especially  when 
he  considers  the  consequences  of  allowing  a  faulty  automatic  landing  system  to  main¬ 
tain  control  too  long,  Thus,  the  automatic  guidance  end  landing  system  engineer  must 
consider  during  the  design  stage  what  the  pilot  wants  to  see  and  plan  accordingly. 


CONCLUSIONS 


A  number  of  conclusions  have  emerged  during  the  course  of  this  study.  Although 
many  of  these  findings  have  already  been  presented  in  preceeding  sections  of  the  paper 
we  would  be  remiss  if  we  did  not  gather  them  together  under  a  single  heading.  There 
has  been  no  real  attempt  to  list  them  in  order  of  importance  beyond  the  authors' 
subjective  Judgment.  All  of  the  conclusions  are  supportable  by  the  research  and 


analyses  which  collectively  comprise  this  study.  In  some  cases,  the  scope  of  this 
paper  precludes  Inclusion  of  all  supporting  evidence  for  all  conclusions .  The 
references,  however,  provide  ample  Information  for  the  Interested  reader. 

•  A  logically  and  mathematically  sound  methodology  for  estimating 
field  of  view  requirements  has  been  developed, 

s  The  resulting  field  of  view  requirements  depend  in  a  critical  way 
on  the  predicted  model  of  the  ship's  airwake  disturbance  environment, 
Validation  of  the  airwake  environment  for  VSTOL  operations  with  avia¬ 
tion  facility  ships  is  therefore  Imperative.  If  airwake  turbulence 
should  prove  to  be  as  upsetting  in  reality  as  the  present  modal 
suggests,  the  aircraft  will  need  high  authority,  high  bandwidth 
flight  control  systems  in  order  to  function  effectively  in  this 
environment  .  ’  ,  much  higher  than  is  typical  of  current  helicopter 
practica. 

s  Based  upon  the  analyses  performed,  it  appears  that  the  pilot  probab¬ 
ly  could  not  obtain  a  satisfactory  laval  of  hovering  precisian  in 
the  conditions  considered  without  either  active  guet  alleviation  de¬ 
vices  or  an  overall  reduction  in  gust  velocity  level.  The  letter 
could  be  achieved  with  a  reduced  wind-over-deck. 

s  It  is  desirable,  from  the  standpoint  of  reducing  field  of  view  require¬ 
ments,  to  provide  visual  cues  and  visual  landing  aids  above  the  hangar 
for  assisting  the  pilot  in  arresting  the  approach  and  providing  hovering 
guidance. 

•  The  constant  relative  bearing  approach  trajectory  appears  preferable. 

In  closing,  we  would  like  to  mention  that  all  aspects  of  the  piloting  problem 
discussed  in  this  paper  are  currently  under  investigation  by  the  U.  S,  Navy,  At  one 
extreme,  the  behavioral  sciences  are  concerned  with  the  fact  that  the  specific  nature 
of  the  perceptual  cues  used  by  a  pilot  to  guide  and  oontrol  an  aircraft  in  contact 
flight  are  unknown,  although  perceptual  theory  suggests  that  they  are  primarily 
visual  and  could  be  determined  by  appropriate  experimentation.  Previous  attempts 
to  specify  the  actual  visual  cues  ussd  in  contact  flight  have  been  unsatisfactory 
possibly  because  of  the  complexity  of  the  problem  anu  because  of  the  predominantly 
theoretical  nature  of  the  investigation. 

In  a  mors  hardware  directed  development,  the  Navy  Vertical  Take-Off  and  Landing 
program  in  pursuing  multiple  goals  all  oriented  toward  providing  Improved  approach, 
hoever,  and  landing  capabilities  of  Navy  and  Marine  Corps  VSTOL  aircraft.  Included 
within  this  very  broadly  stated  goal  are  separate  efforts  to  develop  integrated 
flight  controls  and  display  systems,  landing  guidance  systems,  visual  landing  aids, 
piloting  techniques  and  procedures,  and  ship  motion  forecasting  techniques,  It  is 
to  these  ongoing  investigations  in  both  the  behavioral  and  engineering  sciences  that 
the  field  of  view  methodology  can  contribute. 
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APPENDIX  A 


SESSION  I  DISCUSSION 


Paper  No.  2  and  3  (Professor  Ssrgant) 


Comment  by  Dr.  L.  Back,  Standard  Elektrik  Lorenz  AG,  Dept.  CNS/W8,  Hallmuth-Hirth  Straaaa  42,  7000 
Stuttgart,  40,  Fadaral  Republic  of  Germany : 

Could  you  give  ue  eome  comparison  of  computer  run  time  efficiency  among  the  aimulatlon  languages 
you  mentioned? 


Author* a  raaponae: 

I  do  not  know  of  any  completed  atudlaa  comparing  tha  computational  efficiency  of  aimulatlon  languagaa. 
There  io  currently  an  effort  at  the  Univeraity  of  Lancia ter  in  England  by  David  Ellison  and  John  Crooks  " 
to  compare  several  general  purpoae  aimulatlon  languagaa.  I  do  know  that  GPSB/H  runs  approximately 
five  times  faster  than  IBM's  SPSS  V.  Plaaaa  remember  that  computational  efficiency  ie  only  one  of  tha 
factora  to  conaider  whan  aelecting  e  aimulatlon  language. 


Comment  I 

Will  new  computer  architectural  such  as  array  processors  help  to  increase  tha  speed  of  simulations? 


Author's  response ! 

1  do  uot  know  of  any  simulations  performed  on  an  array  or  any  other  special  type  of  computer. 
Currently  there  are  research  activitlas  investigating  how  to  have  simulation  performed  on  different 
computer  architectures.  At  the  first  International  Confaranca  on  Distributed  Computer  Systems  held 
October  1-5,  there  was  u  paper  investigating  how  to  perform  aimulatlon  on  a  distributed  computer  by 
R.  E.  Bryant  of  MIT;  at  tha  International  Symposium  held  in  August  1977,  there  wae  a  paper  by  M.  Parent 
of  I.R.l.A.  I, aborts  in  Franca  describing  their  efforts  to  investigate  building  a  spaclal  computer  for 
simulation!  and  I  had  a  Fh.D  student  whose  research  was  on  investigating  the  use  of  an  associativa  memory 
and  a  random  access  memory  for  use  in  performing  simulation. 


Paper  No.  4  (Dr.  Franks) 


Comment  by  J.  0.  Wohl,  Program  Chairman,  Tha  MITRE  Corporation,  P.O.  Box  208,  Bedford,  MA  01731,  U.S.A.t 

I  have  heard  the  test  of  a  perfect  bureaucracy  defined  as  follows i  If  you  turn  off  all  of  its  inputs, 
will  its  outputs  continue  as  though  nothing  happened?  I  have  sometimes  had  tha  same  thought  with  regard 
to  some  large-scale  simulations,  Dr.  Franke,  what  has  been  your  experience? 


Author' a  response! 

My  experience  has  been  that  the  validation  problem  is  always  with  us.  On  the  other  hnnd,  large-scale 
simulation  is  particularly  helpful  in  understanding  the  integration  of  technical  and  operational  problems. 
There  ere  limitations;  in  particular,  the  time  and  funds  available  to  perform  the  simulation  and  the 
correlation  between  the  simulation  and  the  real  world  must  be  considered.  But  in  my  experience,  large-scale 
simulation  relative  to  large-scale  system  development  program  is  very  cheap. 


Paper  No.  5  (Mr.  Leedom) 


Comment  by  Dr.  11.  A.  F.  Roefs,  National  Aerospace  Laboratory,  NLR,  Voorsterweg  31,  Emmerloord,  Nethsrlanda: 

Could  the  use  of  "human  gamers  simulation"  indicate  where  and  how  we  should  go  in  the  future)  more 
centralization  of  the  decision  process  at  higher  echelons  or  more  delegation  to  lower  levels?  And  how 
would  this  relate  to  the  type  of  conflict,  such  ns  sir  defense  vs.  guerilla  warfare? 


Author's  response! 

2 

We  already  accept  the  notion  thut  a  C  system  tends  to  exhibit  a  distributed  decisionmaking  process. 
One  emphasis  given  to  IAC  ASSESSOR  was  the  need  to  explicitly  portray  each  individual  C2  element  ao  we 
co  ,cd  observe  the  distributed  (or  mmcentralized)  nature  of  the  total  system.  Our  research  to  date  is 
.tot  complete  enough  to  suggest  the  degree  of  centralized  C2  needed.  As  to  the  use  of  human  gamers,  we 
have  found  that  this  is  an  expensive  approach  to  simulating  distributed  C2  systems.  This  is  because  of 
the  large  personnel  nnd  facility  resources  required.  The  artificial  intelligence  approach  is  a  much  less 
costly  approach  to  nlmuleting  and  studying  distributed  C2  systems.  The  questions  of  "what  degree  of 
centralization  in  required"  iu  influenced  by  a  number  of  factors.  Among  these  are! 

-  The  scape  of  information  available  at  each  level  in  the  C2  hierarchy 


-  Th»  digtu  to  which  the  information  is  fused,  filtered,  and  tailored  to  the  "problem  atructura" 
assumed  at  aach  leval  lu  the  C2  hierarchy 

2 

-  The  availability  and  vulnerability  of  communication  links  between  each  level  of  the  C  hierarchy 

Aa  one  can  aaa,  the  answer  to  this  question  depends  upon  both  human  factors  and  technical  factors.  One 
also  needs  to  tailor  the  answer  to  different  coribat  environments,  the  Interdependency/  or  interaction, 
among  the  human  components,  technical  componenta,  and  the  combat  environment  suggests  the  need  to 
simulate  this  entire  system.  The  simulation  needs  to  reflect  a  high  fidelity  combat  environment  to 
"drlva"  the  cognitlva  processes.  The  simulation  elac  needs  to  faithfully  rapraaant  the  vulnerabilities 
of  the  C2  system  hardware.  It  la  through  this  type  of  total  simulation  that  anawars  will  be  developed 
to  the  centralization  question. 


Comment  by  J.  0.  Wohl,  Program  Chairman,  The  MITRE  Corporation,  P.O.  Box  208,  Bedford,  MA  01731,  U.S.A.t 

I'd  add  juet  one  note  to  Mr,  Laadom's  answer.  In  the  u.8.  thara  la  a  small  movement  underway  to 
develop  a  taxonomy  of  tactical  declelonaaklng.  Army,  Marina  Corps,  and  Air  Force  researcher*  are 
ettsmptlng  to  mskt  explicit  acme  of  these  "hidden"  decision  rules  and  heuristics. 


Comment  by  Or.  J.  Orlanaky,  Institute  for  Defense  Analyses,  400  Army  Drive,  Arlington,  VA  22202,  U.S.A.t 

Decision  and  cognitive  science  data  deal  primarily  with  individual  decisionmaking.  Command  and 
control  center*  era  concerned  mainly  with  group  decisionmaking,  which  may  also  ba  called  bureaucratic 
decisionmaking.  How  do  you  propose  to  go  from  Individual  decisionmaking  to  "bureaucratic"  decisionmaking 
in  your  simulation*? 


Author's  responssi 

At  this  point  in  our . research ,  wa  are  juet  beginning  to  undaritand  where  individual  and  group 
decision  procssses  occur  (or  predominate)  in  a  C2  eystam.  One  lsaua  wa  era  focualng  on  le  the  influence 
of  organisational  procedure*  (or  lack  thsraof)  on  decision  procssses.  We  know  that  different  commander 
or  battle  staff  personnel  exhibit  unique  decision  styles.  What  wa  are  attempting  to  define  la  the  degree 
of  variability  of  these  processes  for  each  of  the  key  combat  decisions.  I  beliava  that,  In  soma  instances, 
organizational  procedures  would  tend  to  influence  dacislonmaking  to  a  great  degree.  In  other  instances, 
primarily  at  the  higher  achalona  of  the  02  hierarchy,  individual  cognitive  styles  would  predominate. 

Wa  must  ba  aareful  not  to  build  "average"  C2  systems  which  perform  poorly  when  exposed  to  a  particular 
commander  style. 


Comment  by  Mr.  C.  M.  McLean,  British  Aaroapsca  Dynamics  Gp .  Hatfiald/Lostook  Dlv.  Manor  Road,  Hatfield, 
Hertfordshire,  United  Kingdom: 

Whet  pert  does  learning  play  in  the  aimulation  of  human  thought? 


Author'a  response: 

At  present,  we  have  not  included  "learning"  feature!  into  the  TAC  ASSESSOR  model.  One  technique 
employed  in  the  model,  algnature  tables,  ceil  be  applied  In  e  more  general  form  to  Include  learning. 
Appllcatloni  of  signature  tables  to  computer  chees  models  have  included  the  modification  of  coef ficianta, 
based  upon  historical  data  generated  by  the  model,  itealf.  Thus,  we  expect  to  address  this  feature 
later  on  In  our  reeeerch. 


Comment  by  Mr.  C.  M.  McLain,  British  Aerospace  Dynamic!  Op.  Katfleld/Lostock  Dlv.  Manor  Road,  Hatfield, 
Hertfordshire,  United  Kingdom 

To  what  extent  is  time  stability  considered? 


Author's  response: 

At  present,  we  have  not  formally  addressed  the  subject  of  stability.  Our  approach  (which  la  based 
upon  evant-stepped  aimulation)  racognizaa  the  importance  of  transient  phenomena.  I  believe  that  many 
unstable  solutions  are  poasible,  depending  upon  the  availability  of  communication  links,  the  quality  of 
the  perception  algorithms,  and  the  quality  of  the  planning  and  controlling  logic.  It  remain*,  however, 
what  instability  we  will  actually  find. 

Because  w*  bol'lave  that  somt  systems  might  be  unstable,  we  have  rejected  more  simplified, 
closed-form  solutions  of  the  C2  effects.  Again,  we  are  not  trying  to  optimize  c2  performance,  per  ae; 
we  are  first  attempting  to  find  out  how  real  C*  systems  work. 


Comment  by  Dr.  L,  Back,  Standard  Elektrlk  Lorenz  AG,  Dept.  CNS/TWB,  Hellmuth-Hirth  Strnsaa  42,  7000 
Stuttgart,  40,  Federal  Republic  of  Germany: 

la  your  decision  simulation  adaptive  to  different  environments  or  situations? 


Author' «  response: 


We  have  mad*  a  conscious  effort  to  construct  dsclslon  logic  (production  rule  systems,  signature 
tables,  etc.)  which  are  independent  of  specific  scenarios  or  situations.  Other  models  which  I  have 
observed  in  this  asms  field  tend  to  have  scenarios  and  objectives  embedded  within  the  decision  logic. 
This  feature  requires  extensive  change*  to  the  decision  logic  whenever  the  scenario  or  combat  situation 
is  modified. 


Consent  t 

Can  your  simulation  be  made  adaptive  in  the  absence  of  a  complex  learning  ability? 


Author's  response 

The  TAC  ASSESSOR  model,  in  its  present  form,  does  not  feature  learning.  One  technique*  used 
(signature  table*)  has  been  applied  in  the  past  to  computer  chess  programs.  Learning  technique*  can 
be  incorporated  into  this  technique  end  even  programmed  to  rely  on  historical  data  generated  by  the 
simulation  model,  itself.  I  envision  that  laamlng  features  will  be  addressed  by  our  study  effort 
in  the  future. 


Comment  by  J.  H.  Powell,  Advanced  Projects  Dept.  British  Aerospace,  Warton  Aerodrome,  Preston,  Lance, 

United  Kingdom! 

At  the  beginning  of  the  lecture,  it  wee  stated  that  not  all  human  decisions  vara  rational  (in  tha 
aanae  of  balng  consistent  with  the  "view"  held  of  the  game  at  the  time  of  tha  decision) . 

1.  How  does  tha  degree  of  rationality  alter  with  atresa,  both  phyalcal  and  in  term*  of  tha  urganoy 
of  tha  daclalon? 

2.  Doaa  tha  vary  nature  of  the  daclalon  process  altar  with  thaaa  atreaa  lavela  and  if  ao  in  what  way? 


Author's  reply! 

Stress  and  u  ssnee  of  time  urgency  tend  to  reduce  tha  complexity  of  the  decision  process.  Using 
Soviet  technology,  stress  would  tend  to  move  one  from  more  complex  cognitive  processes  (axiomatic  or 
analytical  thought)  to  more  simple  ones  (empirical  thought) .  We  need  to  account  for  this  type  of  shift 
in  our  simulation  of  thought  processes.  Under  atresa,  thought  would  bacoma  lass  rational  in  tha  following 

eaneei 

-  Fewer  problem  variables  would  be  acknowledged  and  used  to  influence  a  solution 

-  Objectives  would  be  reduced  in  a  complexity 
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-  A  search  for  a  satisfactory  problem  solution  would  be  less  exhaustive 


Comment  by  J.  0.  Wohl,  Program  Chairman,  The  MITRE  Corporation,  P.0.  Box  20B,  Bedford,  MA  01731,  U.S.A. I 

A  ueeful  reference  on  the  subject  of  decisionmaking  under  stress  is  a  book  entitled  "Decision 
Making"  by  Janie  and  Mann. 


Comment  by  R.  J.  Morrow,  British  Asrospace,  Dynamics  Croup,  P.O,  Box  No.  77,  Bid  lbV,  Filton  Housa, 
Bristol,  BS99  7AR,  Unltsd  Kingdoms 

How  do  you  create  a  true  manure  of  utility  for  your  simulation,  so  that  you  have  a  goal  towards 
which  to  move? 


Author's  response! 

Remember  I  said  there  were  two  types  of  measures,  those  internal  to  the  commend  and  control  aystem 
having  to  do  with  performance,  and  those  internal  to  it  having  to  do  with  utility  or  effectiveness. 
Effectiveness  is  measured  by  such  parameters  as  attrition  and  exchange  rates,  and  whnthar  the  Forward 
Edge  of  the  Battle  Area  i*  moving  toward  or  away  from  ua,  Obviously  such  measures  art  influenced  by 
numerous  factors  other  than  command  and  control,  such  as  force  ratio  and  weapons  effectiveness.  But 
there  is  a  third  type  of  measure  which  we  are  Just  beginning  to  understand  is  needed.  If  on*  rsslly 
wishes  to  understand  the  utility  of  a  particular  command  control  capability,  one  must  also  look  closely 
at  the  human  deciaion  process  involved,  That  is,  in  addition  to  taking  the  parfnrmanca  and  effectiveness 
measures,  one  must  also  Identify  the  kay  decisions  mads  by  a  commander  and  assess  how  well  they  can  be 
made  both  with  and  without  some  specific  command  and  control  capability.  We  don't  have  a  praclie 
definition  of  this  Intermediate  measure  yet,  but  it  is  related  to  how  well  a  piece  of  hardware  or  command 
and  control  capability  supports  key  decision  processes.  All.  three  types  of  measures  ere  needed. 


Paper  No.  6  (Dr.  Salb) 


No  comments. 
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SESSION  II  DISCUSSION 


Pacer  Mo.  7  fife.  Holllndej 


Comment*  by  Mr.  D.  Lee  cl  cm,  Headquarter*  U8AF/SAGR,  Washington  D.C.  20330,  U.S.A.  t 

Have  you  found  a  systematic  mean*  of  aaaaaalng  the  commander'*  real  Information  needs?  Do  you  find 
commander*  asking  for  mer*  Information  than  they  really  need  to  conduct  successful  operation*? 


Author'*  r*ipon**t 

No,  w*  did  not  find  any  systematic  mean*.  In  German  force*  regulation*  exist  about  hew  to  atate 
information  no*d* .  Commanders  have  to  writ*  information  concept*  In'  a  given  structured  form,  but  do 
not  succeed  vary  well  in  doing  so.  They  generally  askod  for  1***  information  and  then  discovered  that 
they  needed  mors.  Using  conventional  information  flow,  they  either  gat  a  mass  of  Information  or  nothing 
becaua*  of  cosmatancs  problem*,  So  they  tend  to  rely  on  intuition.  But  when  they  see  that  they  can  gat 
structured,  selected  information  by  CCIS,  they  start  asking  for  more. 


Comment*  by  Ir  N,  Van  Drlsl,  N.L.R,  Anthony  Fokkarwsg  2,  1059,  CM  Amsterdam,  Netherlands i 

Is  KMFIS  intended  for  specific  military  actlona  or  for,  optimisation  of  the  overall  task  of  the  Army/ 
Air  Pores?  Also,  1*  it  intended  for  continuous  monitoring  within  the  military  of  varioue  activities? 


Author's  response i 

EMFIS  la  an  experimental  system,  supposed  to  analyze  and  train  in  the  use  of  CCIS.  It  consist*  of  a 
system  part  and  various  user  models.  The  system  part  is  structured  to  support  the  (r  process  in  the 
static  headquarters,  but  more  at  the  operational  laval  than  the  tactical  level.  The  main  user  modal  is 
tailored  for  situation  monitoring  of  the  overall  military  situation  for  political  decisions.  So,  for  the 
first  part  of  the  question  tha  anawar  for  tha  tlma  being  is  "no";  for  th*  aacond  part  it  Is  "yts"  for 
tha  given  objective. 


Comments  by  A.  Bbmisch,  IABG,  mbH ,  Einsteins trasse  2 0 ,  8012  Ottobrunn,  Federal  Rapubllc  of  Gartitanyl 

What  ar*  you  doing  to  liva  within  the  axletlng  time  conetralnte  with  the  poor  trenemleelon  quality 
of  axiating  data  circuitry? 


Author's  rasponsai 

EMFIS  is  an  experimental  system.  So,  bacause  of  tha  llmltad  budgat  not  too  much  emphasis  waa  put  on 
survivability. 


Commantl 

Are  you  ualng  altemetlve  routing  end  specie!  protocols? 


Author's  response) 

The  system  will  normally  utilise  German  PTT  permanent  phone  linee,  especially  the  TTY  lines  which  in 
cess  of  break  down  can  be  altered  to  another  route  by  tha  PTT,  It  can  alao  utilize  military  radio  commu¬ 
nication  links  in  permanent  mod*.  This  is  not  what  wa  would  recommend  for  future  operational  aye  tana, 
because  of  cost  and  lack  of  aurvivablllty .  But  systems  like  a  packat-awitohad  communication  network  arc 
not  yat  available  and  still  have  technical  and  procedural  problems. 


Commantl 

Are  tha  aama  data  links  used  for  dsta  acquisition  and  command  control  msaaagas? 


Author's  rasponsai 

Each  user  can  b*  a  reporting  or  querying  user  in  tha  frame  of  his  function.  In  addition,  there  is  a 
punched  paper  tape  input/output  interface  to  tha  conventional  communication  (TTY)  network  of  the 
Bundeawehr  for  reports  (data  acquisition)  and  orders. 


Comment  by.  Xr  H.  A.  T.  Timners,  Panel  Chairman,  Head  Electronics  Dept.  N.L.R.  Anthony  Fokkarweg  2,  1059, 
CM  Amsterdam,  Netherlands t 


What  have  you  done  so  far  in  validation  and  varifioation  of  the  model? 


Author's  reaponsat 

Varifioation  and  validation  before  completion  appears  to  ba  rather  difficult  if  not  impossible.  Our 
model,  however,  le  as  I  aald,  naaring  completion  in  its  first  version.  Efforts  have  bean  planned  in  the 
areas  of 

-  Hardware  test/conparison 

-  Data  collection  in  operational  ays terns 


Comment  t 

Does  the  interest  expressed  for  the  modal  coma  from  the  scientific  field  or  from  the  military  field? 


Author* a  raaponaat 

Sincere  intaraat  ha*  been  axpraaaed  from  bath  sldae  as  tha  modal  will  fill  in  a  "white  spot"  in  the 
array  of  air  defame. models,  at  laaat  nationally.  Military  users,  of  courts,  will  accept  tha  modal  only 
after  a  varifioation  and  validation  process  as  scheduled  (i.e.,  "proof  of  principle"). 


Comment  by  Dr.  H,  Kuereten,  Aaelatant  Scientific  Advisor  to  S4CEUR,  SHAPE,  Mohs,  Belgium! 

On  which  level  of  national  or  NATO  commend  have  the  operational  requirements  (l,a.,  information 
needs,  communication  lines,  warning,  etc.)  been  established  for  your  simulation  of  overall  Air  Defense 
Command  and  Control?  How  do  you  intend  to  allar  for  tha  same  platforms,  sensors,  bases,  etc,  In  multiple 
mi  eel one?  in  mutual  interference  (IFF,  EMC)?  in  air  space  deconflictlon? 


Author's  raaponsei 

Tha  modal  ea  presently  developed  is  restricted  to  sir  defense  C2  up  to  the  S00/AD0C  level)  i-.hue  the 
problem  of  assignment  of  multimillion  aircraft  to  attack  or  dafanae  cannot  be  solved  by  the  model  but 
must  ba  input.  Information  requirements  on  tha  various  lavala  of  AD-C2  will  ba  typical  raaulta  of 
analyaaa  supportable  by  this  modal  rather  than  input  to  it. 

EQM  (SOJ,  CBJ,  SSJ,  ESJ ,  CHAFF)  are  represented  in  the  model  as  is  procedural  IFF  by  hostile  criteria. 
S1F  idantlf ication  will  not  ba  sufficiently  modeled  as  long  as  there  is  no  reliable  performance  data  on 
those  systems,  which  is  presently  the  case.  "Air  space  management"  will  remain  reserved  to  future  exten¬ 
sions  of  tha  model  which  will  not  be  done  before  ths  Air  Defenee  version  will  have  proven  velid  end 
applicable. 


Comment  by  F.  Hartmann,  ESO  Elektronik  System  GmbH,  Poatfach  80  05  69,  8000  Mllnchsn,  Federal  Republic 
of  Germany! 

Can  you  give  us  an  idea  about  the  increase  of  weapon  system  effectlvity  by  tha  application  of  C^7 


Author's  response! 

Presently  not)  however,  the  modal  described  has  been  actually  designed  to  give  an  answer  to  this  type 
of  question. 

To  my  knowledge,  there  is  no  study  available  which  really  quantifies  the  C2  weapon  aystsm  effective¬ 
ness  equivalent  in  a  broader  eanse  (e.g.,  overall  air  defense).  One  early  aximple  le  tha  BTC  study  on 
fighter  performance  with/without  AWACS  beinR  implemented.  But  this  study  wee  limited  to  A/C  weapon 
eye tame. 


Paner  No.  9  (Lt.  Col,  lynch) 


Comment  by  Professor  R.  G.  Sargent,  Department  of  Industrial  Engineering  and  Operations  Research,  Syracuse 
Univoristy,  441  Link  Hall,  Syracuse,  N.Y.  13210,  U.S.A.i 

Systems  In  use  today  era  continuing  tc  increase  in  sies  and  complexity  with  the  result  that  when  a 
failure  or  failures  occur,  wo  lose  the  total  system  independently  of  how  they  art  designed  to  avoid  this. 
An  example  of  this  is  the  power  InduHtry  in  the  United  States.  You  have  not  addressed  this  in  your 
presentstion  on  C*  systems  and  my  question  is,  Is  this  baing  investigated? 
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Author'*  rMponati 

Your  qu**tlon  really  concern#  th*  maintainability  and  aurvlvabillty  of  S3  eystme  and,  what  la  nor* 
Important,  thalr  impact  on  military  worth.  Both  ara  accounted  for  In  th«  above  modallng  effort.  Though 
maintainability  1*  important,  aurvlvabillty  la  oven  mora  »o.  The  vulnarablllty  of  each  C2  alt*  to  offen¬ 
sive  weapon*  and  their  accuracy  la  Included  In  tha  model.  C3  ayatama  have  a  high  targeting  priority  by 
the  threat.  All  of  the**  aynergletlc  affect*  era  lh  the  modal  and  impact  th*  military  worth  of  th*  C* 
ayatam. 


Comment  by  C.  M.  McLean,  Brltiah  Aaroapaa*  Dynamic*  Gp.  Hatfleld/Loatock  Dlv.  Manor  Road,  Hatfield, 
Hartfordahlra,  United  Kingdom) 

How  do  you  anaur*  th*  flexibility  and  th*  continued  validity  of  a  monolithic  centralised  modal? 


Author'*  response) 

I  agra*  that  thia  1*  accessary  and  w*  raeognliad  th*  need  very  early.  At  tha  outset  of  this  develop¬ 
ment  we  began  briefing  th*  DADBMS-C2  modal  charactariatlee  to  many  group*  within  th*  Air  Catena*  cowsunity, 
at  all  level*.  Input*  war*  obtained  from  these  groups  and  appropriate  change*  mad*.  Th*  resulting  model 
flexibility  1*  such  that  it  can  accept  a  wide  variety  of  change*  in  system  concept*  end  tactical  situa¬ 
tion*.  Hence,  it*  expected  lifetime  1*  at  l*a*t  10  or  IS  yeara. 


Paper  Ho.  10  (Mr.  Wilhelm) 


Comment  by  Mr.  A.  J.  Meclumphe,  Royal  Air  Force  Institute  of  Aviation  Medicine,  Famborough,  Hampshire, 
United  Kingdom) 

A  lot  of  peopl*  have  spoken  about  th*  presentation  of  n«c*»»arv  information.  Have  you  assessed 
whet  Information  jL*  necessary  for  effective  task  psrformanca? 


Author's  response) 

This  Is  certainly  a  valid  question,  but  as  1  said  In  th*  presentation  we  are  just  starting  to  put  th* 
human  decisionmaking  capability  back  into  th*  simulation,  and  one  of  th*  mora  important  quaationa  to  be 
approached  is  exactly  your  question.  This  is  an  area  which  certainly  daservae  further  research. 


Comment  by  Dipl.  Ing.  R.  Huttar,  Industrleanlagen  Batrlabngssellschaft  mbH,  Einstelnstraes*  20,  6012 
Ottobrunn,  Fadaral  Republic  of  Oarmanyi 

When  putting  the  man- in- the- loop  and  trying  to  assess  future  (1990)  weapons  and  C2  systems,  you  will 

find) 

a,  Experienced  commanders  from  presently  operational  systems 

b,  Experienced  anglnaars  of  future  systems 

c,  Nobody  experienced  Ln  the  operation  and  C2  of  those  future  systems 

How  will  you  find  people  with  the  raqulred  qualification  in  (c)?  If  you  don't  you  will  never  knew  whether 
your  model  is  working  close  to  the  C2  optimum  or  far  away. 


Author's  response) 

Th*  simulation  setup  planned  la  of  an  experimental  nature  and  should  serve  primarily  as  a  tool  for 
providing  a  batter  underatandlng  of  the  problems  lnvolvsri  in  human  decisionmaking  for  battl*  management 
in  tha  air  defense  system.  This  being  th*  csss  w*  do  not  plan  to  bring  commander*  With  experience  on 
presently  operational  system*  into  the  gams  at  an  early  stags  of  development.  The  first  test  runs  will 
bs  performed  with  scientists  from  uur  cam  establishments  who  are  familiar  with  tha  state-of-the-art. 

After  having  established  th*  validity  of  the  methodology  and  of  th*  msn/machln*  interface,  w*  might 
Invite  one  or  several  experienced  military  commanders  to  participate.  What  th*  results  will  b*  I  don't 
know  at  th*  moment)  1  am  quits  confidant,  however,  that  th*  human  adaptability  and  capability  to  leam 
will  permit  us  to  carry  out  th*  experiments  w*  have  in  nlnd. 

Additionally,  I  would  like  to  emphasitt  that  this  man-ln-tha-loop  simulation  is  supposed  to  be  an 
intermediate  step  which  hopefully  will  enable  us  to  design  elgorthme  describing  human  decisionmaking 
that  ahould  raplaca  thoaa  algorithms  which  ere  currently  Implemented  in  the  model  and  vhich  ara  lacking 
adaptlvanesa ,  are  nohorlouely  rigid,  Inflexible,  and  represent  only  one  of  e  whole  set  of  poeslblt 
strategies, 


Comment  by  Mr.  G.  Wunderlich.  Indus trleanlagan  Betrisbsgsssllschaft  mbU.  D  8012  Ottobrunn(  Binsteinatrasse, 
Fedorol  Republic  of  Germany i 

Regarding  Air  Catenae  force  alee  effect:  What  la  your  experience  with  raepect  to  varioua  avionlca/ 
armament  on  both  aldee  (Example:  multitarget  ve.  single  target  capability)?  We  found,  for  example,  the 
multitarget  capability  to  be  a  driving  factor. 


Author*  a  raeponea: 

This  question  wee  the  subject  of  a  thorough  investigation  during  the  lest  2  years,  the  results  of 
which  ere  classified  higher  than  this  meeting.  This  study  Is  available  et  youv  organisation,  however. 
I  agree  that  specific  avionics/armamant  parameters  may  be  Important)  however,  they  will  certainly  not 
change  the  flrat  order  impact  of  the  force  sisa. 


Comment : 

Regarding  Air  Defense  target  selection  logic:  Your  presentation  differs  from  your  paper.  You  stated 
today  that  you  always  choee  the  "best"  logic;  but  in  your  paper  you  indicated  a  random-type  selection 
(l.e. ,  Pilot's  decision  is  not  sensitive).  Doss  that  mean  that  you  changed  from  the  random- type  selection? 
Prom  our  experience  we  found  the  target  selection  process  to  be  very  aansltlva  which  seems  to  be  in 
contrast  to  your  experience. 


Author's  response: 

Your  second  question  is  concerned  viuh  the  target  solsction  logic  of  the  fighter  pilot  as  implemented 
in  the  model.  At  no  place  in  the  paper  i*  it  stated  that  a  random  selection  logic  is  being  applied.  All 
the  paper  says  is  that  different  types  of  election  logics  ware  tested.  The  general  result  obtained  from 
a  large  number  of  test  runs  indicated  that  other  factors  were  of  higher  significance  in  determining  trends 
than  a  selection  logic,  the  rationale  tor  which  remains  unvalldated  in  any  caaa. 

Thera  seems  to  be  a  misunderstanding  of  the  basic  concepts  of  randomness  and  sensitivity.  If  a 
parameter  used  in  a  modal  la  insensitive  (compared  with  other  parameters)  it  does  not  mean  that  this 
parameter  is  random. 

You  are  referring  to  your  own  experianca  indicating  somewhat  different  results.  As  I  do  not  know 
whet  you  investigated,  1  am  not  able  to  comment  on  this.  Of  course,  t  am  interested  to  laam  how  you 
might  have  come  to  different  conclusions. 


Paper  No.  11  (Mr,  Wunechmann). 


Comment  by  Mr,  a.  M.  McLean,  Brltiah  Aeroapaca  Dynamic*  Gp.  Hatf iald/Loatock  Dlv.  Manor  Road,  Hatfield, 
Hertfordshire,  United  Kingdom: 

In  a  conflict  in  Central  Europe  each  side  will  ha  both  an  attacker  end  e  defender.  What  facility 
la  availabl*  in  tha  model  to  include  the  effect  of  both  the  etteck  end  defenee  rolee  on  the  workloed 
for  eech  elde?  Aleo  what  can  be  dona  to  quantify  this  effect? 


Author' e  reaponaa: 

Since  oure  is  an  Air  Defenee  simulation,  we  do  not  simulate  the  effects  of  our  own  sttseking  forces. 
Ws  havt  them  in  our  threat  sosnarlo,  ws  ess  them  on  our  scopes,  and  ws  try  to  identify  them.  Thus  ws 
rspresent  only  s  "slice"  of  the  total  conflict.  But  again  1  muet  emphaelse  that  our  elmuletion  is  maant 
to  support  primarily  operational  training  rather  then  operation*  reeaarch. 


Comnant  by  Dr.  J.  Barrett,  Heed  of  Helicopter  Diepleye  Section,  Flight  Syetame  Dept.  RAE,  Famborough, 
Hanta,  United  Kingdom: 

In  your  preeentstion,  you  ehowed  a  elide  which  geve  an  indication  of  the  large  difference  in  Identi¬ 
fication  time  between  an  operator  who  wee  heavily  loaded  and  one  who  wee  lightly  loaded.  Could  you 
clarify  the  different  task*  which  wore  being  undertaken  during  the  identification  pheae,  end  how  you  are 
attempting  to  quantity  the  workload  on  tha  operator? 


Author's  response: 

Tha  task  of  an  ID  operator  Includes: 

-  Comparison  of  track  parameters  with  a  decision  matrix 

-  Ths  appropriate  twitch  action!  for  each  individual  track  at  tha  data  display  console 
(man/machin*  interf  ace) 
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Tha  time  required  to  ldantlfy  datactad  track*  1*  Influenced  by: 

-  Tha  operator's  training  level 

-  Tha  complexity  of  tha  deeialonaaking  procasa 

-  Daalgn  of  tha  aan/maohln*  lntarfas* 

At  a  cartaln  track  load  even  a  well-trained  operator  cannot  maintain  track  with  tha  ID  requests 
popping  up  at  hi*  conaol*  (saturation  affect) .  Thai*  Unit*  auat  be  quantified  for  feedback  into  the 
ay a tan  daalgn,  oparatlona  procedures,  or  training  schemas. 


Comment  by  Dipl.  Ing.  R.  Huttar,  Industrlaanlagan  Batrlabagasallschaft  mbH,  Elnatalnatrassa  20,  8012 
Ottobrunn,  Federal  Republic  of  Germany: 

Tha  methodology  described  appears  to  be  an  excellent  tool  for  validation  purpoeaa  of  oparatlona 
raaaarch  typa  digital  models, 


Author's  rasponaai 

Yes ,  If  the  conaereial  firm  needs  the  information  within  the  scope  of  a  contract  with  the  NOD  of  a 
NATO  nation. 


Comment  I 

What  are  tha  manpower  and  cost  lnvolvad  in  setting  up  and  simulating  slsable  scenarios  of  tha  order 
of  several  hundreds  of  A/C  targets? 


Author'*  rasponaai 

To  create  a  raglon-wid*  scenario  (about  20  radar  sites)  about  3  months  with  3-4  people  are  Inquired, 
Coat  estimates  cannot  b*  provided. 


Comment t 

I*  the  methodology  applicable  to:  (a)  future  ayatama  mid/or  (b)  modification*  to  tha  present  system? 


Author's  rasponaai 

Tha  simulation  preparation  ayatam  by  its  design  allows  accomodation  of  future  ayatama  and  can  reflact 
changes  to  the  present  system  by  adding  new  program  modules.  Along  those  Unas  it  la  already  envisaged 
to  inalud*  the  NAIW  ayatam  and  tha  U.S,  national  4071  system. 


Cotmnon c  by  Hr.  F.  8,  Stringer,  Penal  Member,  Royal  Aircraft  Establishment  (Rl 77  Bldg),  Rarnborough ,  Hants, 
United  Kingdom 

What  dagraa  of  sophistication  do  you  use  to  anaura  that  ECM  affects  ara  regarded  as  acceptable,  to 
provide  a  more  realistic  contribution  to  tha  simulation? 


Author' a  response: 

BCM  la  still  a  vary  weak  point  in  our  simulation,  Wa  hava  a  rough  modal  of  tha  affects,  but  w*  at* 
■till  not  satisfied. 


Concent  by  Hr,  J.  C,  Wohl,  Program  Chairman,  Tha  MITRE  Corporation,  P,  0.  Box  208,  Bedford,  MA  01730, 
U.S. A. : 

With  regard  to  your  raal-tlm*  simulation  of  air  traffic  control,  what  lasaons  have  you  Uamad  about 
tha  presentation  of  information  for  airspace  management? 


Author's  rasponaai 

Throughout  this  confaranca  many  authors  have  discussed  tha  need  for  appropriate  presentation  of 
Information.  However,  whan  queotionad  about  tha  way  to  assess  tha  appropriate  information  to  display, 
the  rap lias  hava  Indicated  a  gap  in  the  raaaarch.  I  am  not  that  familiar  with  tha  studies  examining 
alrapac*  management  in  ATC,  but  it  la  unquestionable  that  display  design  muat  meet  tha  perceptual  and 
cognitive  needs  of  the  operator,  Design  principles  can  be  suggested  from  existing  knowledge  of  the 
perceptual  processes  of  tha  operator.  Howavar,  there  dcas  appear  to  be  *  lack  of  extensive  raaaarch 
on  the  operational  *f foctivanaa*  of  dlaplaya,  a  situation  t  would  hops  to  aaa  changed  In  tha  next  faw  year*. 
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Comment  by  Dr.  J.  Barrett,  Head  of  Hallcoptar  Displays  Section,  Flight  Syatana  Dapt.  RA8,  Farnborough, 
Hanta,  United  Kingdoms 

You  oald  that  taak  demand*  could  not  ba  directly  equated  to  workload.  Would  you  care  to  aay  what 
therefore  i*  your  definition  of  workload  and  how  can  it  be  successfully  ntaaurad  In  the  operational 
environment?  , 


Author' a  raeponeet 

Workload  ha*  often  been  defined  ae  the  amount  of  effort  required  from  an  operator  in  performing  a 
given  taek.  However,  thie  doe*  not  tend  to  be  a  workable  definition.  Part  of  thia  difficulty  line  firet 
in  the  level  at  which  on*  conaidara  workload.  Are  we,  for  instance,  Interested  In  the  performance  of  an 
laolated <taek  or  the  amount  of  effort  needed  for  a  day'*  work  or  the  effort  required  over  eay,  a  week? 
Secondly,  to  what  extent  do  the  characteristic*  of  an  operator  affect  hi*  workload? 

To  my  knowledge  there  i*  no  valid  way  of  meaauring  workload  on  an  operational  environment.  Much 
reaearch  ha*  aeaeeaed  the  value  of  a  aecondary  taak  technique  as  an  Indirect  measure  of  workload. 

However,  on*  problem  with  this  la  that  on*  ia  never  sure  that  the  aecondary  taak  ia  not  interfering 
with  performance  on  the  primary  taak.  A  recant  symposium  on  the  measurement  of  workload  (Morey,  1979) 
concluded  that  no  general  measure  of  workload  i*  available. 


Coim.ant  by  Nr.  F.  S.  Stringer,  Panel  Member,  Royal  Aircraft  Establishment  (R177  Bldg),  Farnborough, 
Hants,  United  Kingdoms 

Can  simulation  ba  uatd  to  improve  the  perception  of  operator*? 


Author' e  raeponaet 

Perception  le  an  active  rather  than  a  paaaiva  ptocaaa.  Paopla  attempt  to  place  structure  end 
organisation  upon  their  vieuel  environment.  Because  perception  ia  an  active  process,  it  can  ba  manlpu~ 
latad.  Simulation  can  be  used  to  identify  the  perceptual  rues  which  an  operator  uses  to  structure  hie 
environment.  If  one  enn  identify  these  cues,  then  on*  may  be  able  to  manipulate  the  visual  environment 
for  more  affective  operator  performance. 


Paper  No.  13  (Mr,  Hartmann) 


Cossmsent*  by  Dipl,  Ing.  R.  Huttar,  Indue trieenlagen  Betriabsgesellsehaft  mbH,  Elnstelnstraan*  20,  8012 
Ottobrunn,  Federal  Republic  of  Germany) 

Calculation  of  Jammer  strobe  interaction*  only  lead*  to  sufficient  solution*  in  multiple  ECM 
aoanarloa  if  the  target  is  visible  to  at  least  three  rsdur*  ("deghosting") .  At  low  altitude*  terrain 
masking  denies  triple  coverage  in  most  cases).  What  is  your  experience? 


Author's  rasponsas 

Due  to  the  complete  coverage  of  the  entire  surveillance  nsea  even  for  low  flying  air-raft,  Jammers 
can  be  tracked  as  well  as  normal  radar-echo  targets.  For  identification,  ths  bearings  of  less  than 
three  radars  are  sufficient,  llowovsr,  the  combination  of  normal-target  tracking  and  of  Jaaimar  tri angu¬ 
lation  muat  be  presupposed  to  attain  thia  performanen. 


Comments 

A 

Thero  are  chrne  major  contributors  to  the  "C  forcc-sisultiplier"  fnctorl 

-  Avoid  overkills 

-  Reduce  'reaction  times' 

-  Emission  control  of  active  weapons!  sensors 

How  do  these  factors  contribute  individually? 


Author's  responses 

The  greater  part  of  the  force  multiplier  factor  result-)  from  optimal  coordination  of  weapon  system 
engagement .  Thia  depends  greatly  on  the  number  of  targets  passing.  A  single  target  for  example  will  be 
downed  without  fire  coordination.  Thy  factor  reaches  its  maximum  If  the  number  of  target*  ia  equal  to 
the  number  of  weapon  By* testa, 


Consent  by  Hr.  C.  M.  McLain,  British  Aerospace  Dynamics  Gp.  Hetf leld/Loetook  Div.  Manor  Road,  Hatfield, 
Hertfordshire,  United  Kingdom t 

Dots  ths  user  have  the  facility  to  access  the  information  end  genarel  details  of  the  SIMBOX  units 
in  a  font  suitable  to  allow  for  other  types  of  usage  not  envisaged  by  the  originators  of  SIMBOX? 


Author's  response i 

Yes,  The  user  con  access  any  item  of  data  via  the  use  of  staple  user  cells,  at  any  ttae  during  the 
simulation  run.  Typical  questions  which  can  bs  asked  oral  Whet  ia  the  current  position  of  aircraft  a? 
How  many  missiles  does  aircraft  x  have  left?  What  Is  the  position  of  aircraft  x  as  measured  by  radar  y? 
Which  airfield  did  aircraft  x  taka  off  from?  What  is  the  beam  shape  of  the  radar  carried  by  aircraft  x? 


Comment  by  Mr,  R.  J.  Morrow,  British  Aerospace,  Dynamics  Group,  P.  0.  Box  No.  77,  Bid  lbV,  Tilton  House, 
Bristol,  BS99  7AR,  United  Kingdom: 

In  SIMBOX,  how  do  you  cope  with  the  basic  inconsistency  between  deterministic  modeling  (which  is 
needed  to  stimulate  real  equipment)  and  system  modeling  (which  Is  needed  to  observe  and  to  measure 
things)? 


Author's  response: 

In  SIMBOX  as  with  all  event-baeed  simulations,  events  are  taken  one  at  a  time,  in  proper  time 
sequence  but  not  in  proper  or  real  time.  Thus,  there  is  no  way  of  stimulating  real  equipment  with 
SIMBOX,  elnce  real  equipment  operetta  in  real  time  and  would  have  to  be  stimulated  in  reel  time. 
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Paper  No.  13  (Mr.  Shenshan) 

Comment  by  Dipl,  Ing,  R.  Huttar,  Induatrieanlagsn  Batrlabagaaallichaft  mbH,  Elnatainatraiaa  20,  8012 
Ottobrunn,  Federal  Rapublio  of  Germany! 

Ii  tha  diffarantial  aquation  type  modal  "TAG  FENETRATOR"  atill  an  applicabla  tool  or  ia  it  today 
outdated  by  other  USAF  model  davalopmanti  eoma  of  which  va  laamad  from  thia  meeting? 


Author 'a  raaponiat 

Raaulta  from  tha  Air  Force' a  TAC  PENETRATC/R  modal  have  not  appeared  in  print  for  aona  yaara 
(according  to  HQ  USAFE/ACS  rapraaantatlva) i  conaaquantly,  it  may  ba  aaeumed  that  other,  newer  models 
auch  as  those  described  at:  thia  symposium  are  baing  applied  in  its  place.  On  tha  other  hand,  there  ia 
nothing  to  preclude  tha  possibility  of  its  being  needed  for  soma  future  study.  Discussion  with 
HQ  USAF/ACS  (Studies  and  Analysis)  would  ba  appropriate. 


Comment  t 

o 

Is  further  C  mission  effectiveness  modeling  effort  established  at  MITRE? 


Author's  response) 

2  3 

Concerning  MITRE' a  C  (and  fl  )  modeling  efforts,  the  Program  Chairman,  Mr.  Wohl,  would  ba  more 
qualified  to  respond  to  this  question,  since  his  department  at  MITRE  conaidara  auch  topics  as  part  of 
the  C3  architacture  study  process.  Historically,  MITRE  develops  or  acquiree  from  other  agendas  or  from 
oontractora  auch  models  and  simulation!  as  art  approprlata  in  puxault  of  MITRE 'a  work  programs,  Sines 
MITRE  ia  in  tha  C3  buslnaaa,  it  ia  reasonable  to  assume  that  MITRE  has  or  can  acquire  contractor  raaulta 
from  models  and  simulations  in  this  srss, 


Comment  by  Mr.  J.  0.  Wohl,  Program  Chairman,  The  MITRE  Corporation,  P.0,  Box  208,  Bedford,  MA  01730,  U.S.A. I 

Under  sponsorship  of  tha  Air  Force  Electronic  Syatama  Division,  a  modal  ia  currently  being  developed 
by  a  contractor,  CACI,  for  delivery  to  us  by  year  end.  Thia  la  a  specially  designed  modal,  programmed  in 
SIM9CRIPT  II. 5,  for  exploration  and  evaluation  of  alternative  command  and  control  ayatam  architectural. 

It  includaa  a  detailed  submodel,  plus  s  two-aided  sir  mission  submodel  and  a  ground  war  modal. 

Meaauraa  of  C*  effactivanaaa  can  ba  taken  in  terms  of  such  factors  as  air  mission  affaotlvanass,  attrition 
ratios,  and  FEBA  movement. 


Conment  by  Mr.  B.  Taylor,  Marconi  Avlonica  Ltd.  Old  Favkbury  Lena,  Coloney  Street,  8t.  Alban*,  Harts, 
United  Kingdom! 

During  the  early  feasibility  study  stages  of  AWACS,  was  there  an  overall  AWAC9  ayatam  modal  or  wee 
a  more  pragmatic  approach  taken  involving  radar  subsystem  optimisation  followed  by  data  handling  aubaystem 
optimisation? 


Author' a  response! 

There  do  not  appear  to  have  bean  any  overall  AWACS  ayatam  models  that  had  any  real  utility  during  tha 
early  AWACS  Feaelbillty  Study  daya.  Thera  is  sums  svidance  that  tha  Air  Fores  and  certain  contractors 
employed  very  groee  analytical  model*  (a*  opposed  to  computer  modtle)  to  sice  various  subsystems  like  the 
computer,  the  number  of  dlepleye,  and  the  number  of  radio*  to  satiafy  basic  system  missions,  llowevar, 
the  disparity  between  tne  results  of  these  analytical  models  and  tha  E-3A  configuration  today  indlcatas 
that  these  models  had  limited  utility.  To  other  approach  of  computer  modeling  the  crucial  subsystem, 
the  radar,  and  then  uxtending  these  models  over  time  to  include  data  processing,  display,  end  communications, 
appears  to  have  been  the  most  widely  used  end  fruitful  one. 


Comment  by  Mr.  J.  E.  Freedman,  Institute  of  Defense  Analysis,  A00  Army  Drive,  Arlington,  VA,  U.S.A. i 
Please  describe  the  steps  taken  to  validate  radar  performance  models. 


Author's  response: 

Throughout  their  evolution,  the  E-3A  Radar  Performance  Prediction  models  heve  been  validated  by 
comparing  representative  model  outputs  with  actual  flight  teat  results,  where  available.  A »  discussed 
in  the  presentation,  early  model  predictions  could  not  be  validated  because  the  radar  was  not  yet 
developed,  When  the  clutter  data  base  from  brass  hoard  was  gathered  and  incorporated  into  the  modal  In 
1972,  scaling  and  calibration  functions  for  target  conditions  within  as  well  as  beyond  the  scope  of  the 
flight  test  program  were  derived  bo  that  model  predictions  would  match  those  results  which  were  gathered 
in  flight.  This  process  was  repeated  when  even  more  extensive  data  became  available  from  the  DT&E  flight 
test  program.  Again,  analytical  functions  were  derived  to  be  consistent  with  flight  test  results  for 


tho^a  ct.udl  tton*  under  which  flight  taut  data  ware  available  for  comparison.  Aa  data  continue  to  be 
gar.lsred  through  production  ayatan  flight  teatlng,  refinement'  and  added  Bophlaticetione  are  made  so  that 
the  oodal  predictions  natch  flight  teat  result*  for  a  larger  sat  of  E-3A  radar  and  target  condltons. 


Consent l 

Have  tha  radar  nodal*  being  uead  In  the  mission  ainulator*  bean  validated? 


Author's  raaponaat 

The  radar  nodela  In  tha  mission  simulator  are  reasonable  representatlona  of  radar  performance  for 
use  in  training,  but  thay  have  not  been  validated  to  tha  same  depth  as  tha  Radar  Performance  Prediction 
nodela  discussed  In  tha  previous  reply,  nor  do  thay  really  have  to  b*  validated  further.  In  situations 
where  only  craw  training  la  Involved,  the  radar  data  generated  by  tha  simulator  are  adequate.  In 
altuatione  where  radar  performance  realism  Is  required  or  desired,  such  as  mission  analysis  or  ores, 
proficiency  assessment,  data  tapes  from  live  exercises  are  used,  and  radar  performance  modeling  is  not 
needed  or  employed. 

The  other  consideration  in  such  an  issue  is  the  fact  that  radar  outputs  provided  by  the  simulator 
do  not  indicate  performance  of  the  redar  by  themselves  because  the  slsee  (radar  cross  sections,  etc.)  of 
the  targets  are  not  provided.  Consequently,  the  question  of  validation  is  rather  moot. 


Parer  No.  16  (Mr.  Newman) 


Comment  by  Mr.  F.  S.  Stringer,  Panel  Member,  Royal  Aircraft  Establishment  (R177  Bldg),  Farnborough,  Hants, 
United  Kingdom) 

Hee  the  design  of  your  system  included  the  recognition  of  possible  prolonged  periods  of  flight  in  , 
condition*  likely  to  produce  precipitation  atatic,  auch  as  la  generated  by  ice  cryatal  layers  in  cloude? 
How  la  resynchronisation  of  the  Omege  receiver  limuleted  efter  a  period  of  P-Btetlc  paralysis? 


Author's  response) 

Precipitation  static  io  highly  unlikely  to  cause  problems  for  tha  eyeten  becauie  of  tha  Omega 
antenna  design  (dual,  orthogonal  H-fleld  loops).  Howavar,  since  the  elmuletlon  fecility  injects 
simulated  Omege  signals  ea  radio-frequency  signals,  the  NCR  can  rasynchronlee  at  any  time  that  either 
tha  operator  or  the  operational  program  decides  to  do  so.  Us  can  cause  the  NCS  program  to  rasynchronlse 
by  including  an  arbitrary  period  of  high  atmospheric  noise  in  tha  simulation  scenario  through  the  noise 
bias  function. 


Comment  by  Mr.  R.  S.  Vaughn,  Director,  Sansora  &  Avionics  Technology  Directorate,  Naval  Air  Development 
Center  (30)  Warminster,  PA  18974,  U.S.A.l 

The  Air  Force  may  well  choose  to  expand  tha  E-3A  uavlgetionel  functional  group  to  Include  OPS  NAV 
STAR  satellite  navigation  and  perhaps  JTIDS  grid  navigation.  Whet  capabilities  doss  the  subjaqt  simulator 
have  to  accommodate  such  changes? 


Author's  response! 

Expansion  of  the  facility  to  accommodate  outputs  from  GPS  is  no  problem  if  we  only  danira  to  simulate 
the  link  from  the  ueer  equipment  (UE)  to  tha  Omega  rsosiver  computer.  Similarly,  integration  of  a  simple 
JTIDS  relative-navigation  system  interface  would  not  be  difficult.  Naturally,  new  elmuletlon  would  have 
to  be  developed  for  thaee  functional  the  modularity  of  the  current  deaign  should  facilitate  cuch  a  task. 


Paper  No.  17  (Mr,  Rooms,  presenter) 


Comment  by  Mr.  B.  Taylor,  Marconi  Avionics  T.td.,  Old  Perkbury  Lane,  Coloney  Street,  St.  Albans,  Herts, 
United  Kingdom) 

Have  you  addressed  the  problem  of  integration  of  JTIDS  data  into  the  date  bene  with  the  consequent 
Interoperability  problems? 


Author's  rssponss) 

Yts,  vnry  much  so.  Ths  Interfact  Adapttr  Unit  on  ths  E-3A  handltt  til  computer  intsrfscss  with 
onboard  equipment,  including  TADIL  links,  IFF,  tnd  Navigation  systems  ss  well  as  with  JTIDS. 


Paper  No.  18  (Hr.  Easdsle) 


No  comments. 


Paoar  Mo.  19  (Mr.  Alvaret) 


Comment  by  Dr.  H.  A.  F.  Roefs,  National  Aerospace  Laboratory,  NLR,  Vooraterweg  31,  Eransrloord,  Natharlandai 

Could  you  indicata  how  tha  ATI  simulator  handlaa  tha  tracks  whan  tha  total  number  of  targets  exeaed 
the  capacity? 


Author's  response i 

Ths  capacity  of  tha  simulation  modal  can  ha  made  arbitrarily  largej  thua  overloading  is  not  a  problem. 
Overloading  can,  of  course,  be  a  problem  in  ths  operational  program,  and  the  ATI  function  must  be  designed 
with  this  in  mind.  During  our  developroant  efforts,  one  of  the  key  aspects  of  performance  which  was  of  . 
interest  was  the  total  number  of  ttacka  (i.a.,  sum  of  potential,  tentative,  and  established)  in  the  system 
simultaneously.  Conscious  efforts  wars  mads  to  insure  that  the  ratio  of  the  total  number  of  tracks  to  the 
number  of  targets  in  ths  scenario  remained  within  reasonable  limits.  The  insights  gained  during  this 
study  were  useful  in  evaluating  the  track  table  capacities  proposed  by  the  contractor,  which  will  provide 
adequate  margin  to  protect  against  saturation. 


Comnent  by  Mr.  F.  Hdrtmann,  ESQ  Elaktronlk  System  QmbH,  Poatfach  BO  OJ  69,  8000  Mttnchan,  Federal  Republic 
of  Germany! 

Which  search  procedure  do  you  apply  for  quick  association  of  a  radar-derived  plot  to  the  correct 
track,  stored  among  other*  in  your  track  register?  Do  you  check  all  tracks  for  every  association? 


Author's  responses 

For  each  track  in  tha  ayatam,  track  association  and  correlation  io  attempted  against  all  target 
reports  (even  those  that  have  correlated  with  other  track*).  After  track  aaaooiation  and  correlation, 
any  conflicts  (i.a.,  a  report  correlating  with  mora  than  one  track)  are  broken  to  prevent  a  report  from 
updating  more  than  one  track.  Normalised  residuels  are  used  for  determinetion  of  the  "beet  target 
report/traok  pair. 


SESSION  IV  DISCUSSION 


P«n«v  Mo.  20  fPr.  Fluid*) 


Coanera  by  unknown  sourest 

A  pilot's  aanauverability  is  unreatrictad  axcapt  by  aircraft  limitations;  that  la;  ha  can  maka  tha 
aircraft  so  vihara  ha  viahai.  How  many  oicturaa  do  you  taka  from  any  one  point  in  your  manauvarlng  area, 
and  how  do  you  handle  the  Instantaneous  discrepancy  between  tha  Jimulatlon  flight  path  and  the  original 
photographing  aircraft's  flight  path? 


Author's  response! 

First,  wa  taka  a  nuabar  of  pictures  at  every  point.  In  the  flight  elmulator  system  1  described,  we 
take  four  pictures!  three  at  different  angles  and  one  looking  at  instruments.  This  Is  decided  beforehand. 
Whatever  pictures  are  Initially  taken  aarvt  to  define  and  limit  the  flightpathe  which  the  simulation  la 
capable  of  reproducing.  If  you  photograph  a  sat  of  clrcllngs,  a  set  of  takeoffs,  and  a  set  of  landings, 

then  you  have  the  basis  for  the  simulation.  It's  vary  assy  to  taka  thaae  pictures,  hut  it  has  to  ba 

carefully  planned.  The  process  taka*  ona  or  at  moat  two  days  to  complete.  Finally,  it  Is  not  neceeeery 

to  index  each  frame  on  the  video  dlac.  Rather  we  Index  each  fllghtpath  segment  a.nh  as  s  single  takeoff 

or  landing.  Alao  at  path  intersections  we  index  the  alternative  directions.  Thus  discrepancies  are. held 
to  a  minimum  end  are  entirely  determined  by  how  many  different  fllghtpath  segments  were  originally 
photographed. 


Comment  by  Mr.  K.  W.  Pongratz,  IABC  Abt  WTS,  Einateinatraese  8012  Ottobrunn  B.  MUnchen,  Federal  Republic 
of  Germany! 

Did  you  consider  the  use  of  image  distortion  to  allow  the  students  somo  deviation  from  tha  praplanned 
fllghtpeths? 


Author's  response! 

We  have  built  the  experimental  equipment  to  include  distortion  in  order  to  interpolate  among  flight' 
paths.  However  we  did  not  include  this  feature  in  the  Hystem  I  deacribed  today  because  it  greatly  in¬ 
creases  the  cost. 


Comment ! 

Have  you  tried  to  uso  available  commercial  equipment  capable  of  higher  speed  response? 


Author's  response! 

We  have  used  equipment  which  is  10  times  faster  (e.g. ,  multiple  video  dine  players).  This  improves 
the  system  but  again  Increases  the  cost.  But  even  with  the  fastest  equipment  there  are  still  amall 
discontinuities  noticeable  when  the  fllghtpath  changes. 


Comment  by  Dr.  R.  G.  Sargent,  Department  of  Industrial  Engineering  and  Operations  Research,  Syracuse 
fnlvereity,  441  Link  Hall,  Syracuse,  NY  13210,  U.S.A, : 

Could  you  use  this  technique  in  a  training  aircraft  to  compare  the  actual  flightpath  against  stored 
image*  and  determine  when  the  student  pilot  1b  making  a  serious  error? 


Author' e  response! 

That's  a  new  idea  that  we  had  not  thought  of.  It  might  be  a  good  idea. 

Comment  by  Dr.  H,  Kuersten,  Assistant  Scientific  Advisor  to  SACEUR,  SHAPE,  Mons,  Belgium! 

The  flight  dynamics  of  an  aircraft  results  in  only  physically  realizable  flightpathe.  Ia  your  system 
capable  of  simulating  unrealistic  flishtpaths? 


Author's  responses 


Remember  that  the  pictures  are  taken  from  a  real  aircraft  in  flight.  Therefore  no  flight  path  segment 
is  stored  which  is  not  physically  realizable.  While  it  la  true  that  one  could  construct  unrealistic 
flightpathe  from  selected  segments,  our  software  does  not  permit  such  unrealistic  paths  to  be  constructed. 
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Paper  Bo.  2l  (Mr.  Meade; 


Comment  by  Hr,  C.  M.  McLean,  British  Aerospace  Dynamic*  Gp,  Hatfield/Lostock  Dlv.  Manor  Road,  Hatfield, 
Hertfordshire,  United  Kingdom! 

Do  you  tnvletga  the  repreaentatlon  of  threat!  euoh  ae  missiles,  cannon,  and  other  helicopter*  in 
the  near  future?  tfhat  1*  the  tine  leal*  of  auch  development? 


Author' e  response! 

Oul,  noue  panaona  qua  ce  type  d'Atudai  eat  l'un  da  ceux  oh  1*  SDVEM  peut  ttn  la  plus  utile,  an 
permettant  da  almuler  dee  configuration*  da  combat  Alr-Alr,  Impose lb law  k  rCalisar  au  court  d'un  vol 

rdal  d'aaaal. 

La  tamps  ndcAasalru  k  la  mise  an  ofcuvre  d'una  tells  simulation  dipend  essantlallament  da  la 
complexity  du  combat  qua  voua  dlairaa  Atudiar, 


Comment  by  Mr,  H.  W.  Pongrate,  I  ABC  Abt  WTS ,  Einatainatrasae  8012  Ottobrunn  B>  MUnchen,  Federal  Republic 
of  Germany! 

What  field  of  view  do  you  envisage  for  your  simulator? 


Author'*  reaponae; 

A  propoa  du  ays  time  da  restitution  da  la  vision  du  mond#  extkrieur,  11  imports  d  liaaoclar  la  caa 
da  Is  vision  de  Jour  da  cslui  de  la  vision  da  nult. 


Comment  t 


What  resolution  do  you  envisage  your  vleuel  system? 


Author's  response! 

Pour  In  caa  de  la  vision  de  Jour,  je  ne  peux  rlen  dire  k  l'heure  ectuelle,  ne  dlapoeant  pus  dee 
rdsultata  d'dtudes  en  cours. 


Comment  t 

Do  you  see  a  reasonable  compromise  between  field  of  view  end  resolution  requirement*  for  a  daylight 
visual  system  foe  low  level  flight? 


Author's  reaponae: 

Pour  le  cae  de  nuit,  nocre  objcctif  eat  de  mettre  en  place  an  ayathme  qui  Bolt  compatible  avee  las 
specifications  dee  gyatkmes  optronlque*  envipagAs  pour  lea  missions  rSellas  da  nult. 


Paper  No,  22  (Dr.  OrlanBky) 

Comment  by  Ir  H.  A.  T.  Timmerr,  Panel  Chairmen,  Heed  Electronics  Dept.  N.L.R.  Anthony  Fokkerweg  2,  1059, 
CM  Amsterdam,  Netherlands! 

Do  you  have  any  idea  where  the  data  point  would  ba  in  your  first  chart  for  the  APOLLO  flight? 


Author's  reaponae! 

It's  difficult  to  comment  on  that.  The  NASA  program  was  probably  the  moat  expansive  flight  simulation 
program  ever  imagined  in  the  life  of  man,  and  they  wars  not  in  tiny  position  to  judge  whether  or  not  it 
was  coat  effective.  They  did  everything  they  thought  needed  to  ba  done  and  spent  enormous  amounts  of 
money,  but  there's  no  way  to  determine  how  much  it  ahould  have  cost.  Ths  obvious  rsmsrk  ia  that  it  worked; 
but  that's  not  proof.  1  have  nc  way  of  evaluating  what  should  have  been  done  in  the  NASA  program. 


Comment  by  Mr.  J.  G.  Wohl,  Program  Chairman,  Tha  MITRE  Corporation,  F.  0.  Box  208,  Bedford,  MA 
01730,  U.S.A.t 

You  mentioned  in  passing  that  there  was  some  recent  evidence  on  the  utility  of  notion  bases.  Could 
you  Qonment  further  on  that? 


Author's  response) 


This  Is  s  highly  controversial  Issue  on  which  people  era  polarized.  In  1974  Jefferson  Kooncs 
coopered  the  performance  in  the  sir  of  pilots  trained  In  simulators  with  notion  and  without  motion. 

He  found  that  they  performed  equally  wall  in  both  eases.  The  finding  wss  a  total  surprise.  Ho  one  had 
asked  the  question)  Do  you  need  motion?  Doss  it  make  a  difference?  In  30  years,  and  motion  was  being 
included  in  flight  simulators  as  a  matter  of  course  since  pilots  liked  it.  Kooncs'e  finding  was  such  a 
surprise  that  six  separate  studies  ware  dons  to  double  check  it.  This  was  done  for  straight  and  level 
flight,  for  maneuvering  flight,  for  high-fidelity  vs.  lew-fidelity  simulators,  ate.  The  raeulte  were 
absolutely  consistent)  no  difference.  As  s  result,  the  USA?  is  procuring  the  A- 10  flight  simulator 
without  motion  bases. 


Comment  by  Dr.  C.  1.  fields,  Cybernetics  Taehnology  Office,  Defense  Advanced  Research  Projects  Agency, 
1400  Wilson  Blvd,  Arlington,  VA  22209,  U.S.A, t 

Car.  you  make  similar  comments  about  the  visual  fidelity? 


Author's  response) 

Yes,  but  hers  we  have  no  data.  While  a  number  of  studies  have  bean  dons  to  improve  the  visual 
fidelity,  not  one  has  been  aimed  at  determining  whether  that  makes  a  difference  in  performance. 


Comment  by  Dr.  H.  Kuersten,  Assistant  Scientific  Advisor  to  SACEUR,  SHAPE,  Mens,  Belgium) 

I  wonder  if  you've  noticed  performance  differences  among  pilots  who  went  through  these  simulator 
courses  with  different  instrument  layouts,  analog  vs.  digital  displays,  end  mors  or  lies  saalstancs 
from  r>.«  ground  in  making  maneuvers?  The  pilot's  performance  itself  is  not  the  whole  answer;  ha  has 
many  inputs  from  ground-baaad  C3  systems, 


Author's  response) 

Good  question— wa  just  don't  have  the  answer  to  that  yet.  There  era  no  date  dealing  with  this 
subject. 


Comment  by  Hr.  H.  W.  Pongrsts,  IABG  Abt  WTS,  Einstainetrasse  3012  Ottobrunn  B.  MUnohen,  Federal 
Republic  of  Germany) 

Are  technological  improvement!  in  vlaual  simulation  capabilities  hoing  developed? 


Author's  response) 

Yss,  they  era  coming  along  very  fast  in  s  number  of  companies  that  make  visual  systems.  But  I 
question  how  much  of  this  capability  is  really  needed  in  flight  simulators. 


Paper  No.  23  (Mr.  Dreyfus) 

Comment  by  Mr.  C.  M.  McLean,  British  Aerospace  Dynamics  Gp.  Hatfleld/Lostock  Div.  Manor  Road,  Hatfield, 
Hertfordshire,  United  Kingdom) 

On  the  question  of  language,  how  much  attention  must  be  addressed  to  the  problem  of  communication 
between  programmer  and  analyst? 


Author's  response) 

Loreque  nous  rialiaon*  un  zimulatour  da  vol  3  DMT ,  1* analyst*  eat  1*  progrnmmeur  aont 
la  mime  personne.  Nous  avon*  oonetati  qua  la  problima  da  communication  Itait  maaantial 
at  qua  la  maillaur  moyan  da  la  riaoudr*  itait  qua  la  communication  aa  faiaa  au  nlvaau 
d'une'mime  paraonne.  Aatuollomant  noua  utiliaona  prinaipalamant  das  inginleura  qul 
font  auaai  bian  l'analyea  du  probllma  qua  la  programmation .  J*  panaa  qua  catta  tach- 
niqum  aat  utiliela  d'una  maniar*  aasai  couranta  ohaa  laa  autraa  oonatructaura  da 
aimulataura.  Capandant  un  problima  da  communication  axiate  aouvant  antra  la  fabrioant 
du  aimulataur  at  la  cliant,  itent  donni  qua  cm  darniar,  loraqu'il  rajoit  un  programme 
la  oomprand  baauooup  miaux  si  o' aat  un  langaga  qu'il  connait  bian  (I  aavoir  la  FORTRAN 
qui  eat  tria  ripandu  at  bian  connu) ,  plutflt  qu'un  langaga  d'aeaamblaur . 

Mala  il  aa  poaa  quand  mima  4  oa  moment,  la  problima  da  la  documentation  au  nivaau  daa 
programme*.  Par  example,  1*  FORTRAN  ou  tout  langaga  ivolui  aat  auto-documanti ,  o'aat- 
S-dire  qu'an  fin  da  compta  laa  ordraa  aont  dan*  un  langaga  oonnu,  done  facile  I 
comprendra.  Malheurauaamant  ca  n'aat  pea  exact,  pare*  qut ,  an  fait*  la  problima  n'eat 
pa*  da  comprendra  lee  ordraa  qui  aont  axprlmis  dan*  1*  programme,  maia  d*  aavoir  oe 
qua  rapriiante  chaqu*  symbol*  dana  la  programme,  at  pourquoi  tail*  expression  aat  aonuna 
□ala.  Done,  un  programme  FORTRAN  doit  itre  tria  bian  document®  at  avoir  baauooup  da 
commentairas.  II  y  a  capandant  un  autre  problima,  oalui  de  trouver  laa  ordraa  FORTRAN, 
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c'«at-g-dir*  qu'en  fin  da  compte  il  y  •  dans  un  bon  progranmo  FORTRAN  plus  da 
oonmantairaa  qua  d'ordres,  II  faut  qua  la  prograramur  fast a  tr*a  attention  pour  trouvar 
una  miaa  an  page  oorraota  da  naniira  I  pouvoir  ddoouvrir  trfca  rapidamant  la  prograsota 
FORTRAN  propremant  dit.  Sana  oala,  on  na  volt  qua  daa  oommantairaa.  Done,  ja  panaa 
quo,  ai  au  point  da  vua  comprtfhenaion  daa  ordraa  O'aat  plus  facila  dana  la  langaga 
AvoluS,  oa  n'aat  pas  oonplttanant  inmldiat)  il  faut  done  paaaar  un  oartain  tampa  pour 
raodifiar  un  programs ,  qu'il  aoit  an  FORTRAN  ou  an  aaaanblaur. 

Mai a  ja  auia  d' accord  avao  vous,  la  FORTRAN  aat  quand  mdna  un  maillaur  langaga  do 
communication  qua  l'aaaamblour ,  at  ja  rSpita  qua  oo  probllma  axiata  antra  la  fabrieant 
at  la  oliant,  mala  pas  au  nivaau  du  fabrieant, 


Ptpar  No.  ?A  (Ur.  Barrett) 


Comment  by  Dr.  H,  A.  F.  Roefe,  National  Aarospaoa  Laboratory)  NLR,  Vooretarwag  31(  Bnaerloord,  Natharlandat 

Ian*  t  tha  binocular  rivalry  problem  tha  a ana  ai  tha  fatlgua  p rob lan  In  medicine  vhata  doctors  (and 
■tudants)  look  for  rathar  lone  pariods  of  tint  through  nicroacopast  Aa  far  at  1  know  they  are  taught 
to  kaap  tha  laft  eya  open  and  tha  light  laval  high)  while  using  tha  nlerosoopa  with  tha  right  aye. 


Author* a  response t 

Thla  ia  absolutely  true.  Ai  far  as  tha  monocular  vlawing  ay i tan  la  conotmad)  if  tha  light  laval 
into  tha  othar  aya  ia  «<|ualii*d,  tha  rivalry  problan  oomanota  lsuadlataly ,  producing  high  fatlgua.  It 
la  interesting  to  nota  that  extensive  work  has  bean  carried  out  in  tha  United  Kingdom  on  producing 
binocular  viewing  systems  for  microacopaa  bacauaa  of  thla  problem, 


Comment  by  Mr.  Griaon,  Centra  d* Easels  an  Vol,  B.P.  No.  2,  91220  Bratlgny-Sur-Orga ,  Franoal 
Quails  dohalla  choiaia  aur  la  maquatta? 


Author* a  rasponiai 

Tha  original  scaling  of  3000) 1  was  baraly  adequate  for  what  wa  wanted  to  do.  As  a  result)  In  our 
new  simulation  facility  wa  are  changing  to  a  acala  of  1300 il  and  1000 il  in  order  ti  Improve  tha  reeolu- 
,  tlon.  Remember  that  wa  wars  simulating  a  night  vision  aya tarn  in  which  resolution  vaa  baalcally  poor. 

So  there  vaa  no  point  in  trying  to  simulate  a  higher  level  of  resolution. 


Comment i  Quala  aont  laa  probltmas  ranaontrda  au  nivaau  da  la  priaa  da  vua  au  point  da 

vua  daa  aaaarviaaamanta? 


Author* n  raaponaai 

Wa  found  that  wa  required  cervices  capable  of  angular  accelerations  of  1000°/eec^.  Wa  uasd  a  low- 
atnaar  camera  syetan  In  which  tha  readout  was  presented  on  an  axtromely  short  persistence  P-43  phosphor. 
The  raeult  wee  an  ability  to  simulate  pitch  and  rail  rates  of  up  to  120°/aec  representing  a  highly 
manauvarnble  helicopter, 


Comnsnt  by  Ir  N.  Van  Drlal,  N.L.R.  Anthony  Fokkarwag  2,  1059,  CM  Amsterdam,  Netherlands! 

Wa  heard  earlier  that  a  moving  baas  simulator  ia  not  of  such  help.  On  tha  other  hand  you  mentioned 
that  tha  pilot  whan  ha  moved  hin  head,  found  himself  lost.  In  that  casa  could  a  motion  capability  of  tha 
simulator,  aa  in  a  real  aircraft,  help  tha  pilot  to  orient  himself? 


Author's  roaponnat 

I  believe  that  rha  problem  in  thla  case  was  caused  by  the  fact  that  tha  pilot  could  not  aaa  any  out¬ 
side  world  information  othar  than  from  tha  helmet  display.  In  tha  real  aircraft  some  elements  of  tha 
outsida  world  will  always  ba  seen,  which  will  reduce  this  effect,  The  influence  of  motion  ouee,  particu¬ 
larly  from  yaw  in  thla  case  la  vary  small.  1  do  not  feel,  therefore,  that  the  lack  of  this  cue  affected 
this  problem. 


SESSION  V  DISCUSSION 
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Paper  No.  25  (Mr.  Freedman} 


Conran t  by  Dipl.  Ing.  R.  Mutter,  Indue trltanligen  BetriebegeeeUeehaft  mbH,  Zinattinetrasse  20, 

6012  Ottobrunn,  Federal  Republic  of  Germany) 

la  the  performance  of  the  "Direct  Subeyitem  (DSS),"  e.g, ,  SIF  (KK  X,  XII)  input  to  the  teetbed7  If 
yea,  la  thla  data  obtained  from  reliable  aourcea  or  ia  it  a  parametric  input? 


Author'a  raaponaas 

The  DSS  performance  will  be  deacribad  by  a  modal  which  inoorporatee  extensive  enelyaee  of  the  MX  X 
and  MX  XII  SIF  performed  by  STC  and  ba  varloua  U.9.  agenciaa,  These  have  led  to  a  thorough  understanding 
of  the  operation  of  thaea  systems  and  their  reaction  to  the  operational  environment.  The  model  uaad  to 
emulate  these  systems  will  have  a  high  level  of  fidelity  and  will  represent  both  main  and  higher-order 
effects,  as  it  ia  recognised  that  thla  is  eaaentlal  to  the  credibility  of  the  testbed. 


Comment l 

la  the  testbed  designed  and  Intended  aa  a  system  for  the  lnvestlgatlon/taet/snalyala  of  air  defense 
issues  other  than  the  IFFN,  o.g, ,  configuration  of  C3  sites,  network,  and  DP  alternatives? 


Author'a  response i 

Because  the  13S  is  embedded  in  the  C3  system  for  sir  defense,  it  la  necessary  to  have  the  testbed 
represent  this  entire  C3  system  for  an  avaluation  of  identification  to  ba  performed.  The  creation  of 
such  an  extensive  facility  will  probably  stimulate  great  interest  in  its  application  to  broader  purposes. 
We  anticipate  that  the  testbed  may  eventually  evolve  to  ba  a  theater  air  defense  testbed,  although  there 
are  no  definite  plana  for  this  at  this  time. 


Comment  by  Mr.  J.  0,  Wohl,  Program  Chairman,  The  MITRE  Corporation,  P.O,  Box  208,  Bedford,  MA  01230,  U.6.A. I 

An  earlier  paper  lndloatad  that  it  would  take  some  10  centuries  to  run  through  a  complete  simulation 
involving  100  variables,  but  that  that  uould  be  reduced  to  manageable  proportions  through  appropriate 
model  partitioning.  But  with  your  man-in-cha-loop  simulation,  you  will  be  faced  with  an  order  of 
magnitude  growth  in  simulation  complexity  and  run-time.  Do  you  plan  to  make  use  of  statistical  sampling 
techniques  such  as  those  used  in  psychological  experiments  to  again  reduaa  this  problem  to  manageable 
proportions. 


Author's  response i 

We  plan  to  rely  heavily  on  fractional  factorial  experiment  designs.  However,  these  havs  basn 
applied  in  the  past  mainly  to  psychological  experimentation  and  there  is  only  limited  experience  with  tha 
type  of  investigations  required  in  the  IFFN  avaluation.  Therefore,  a  aeries  of  pilot  experiments  will 
ba  performed  to  confirm  the  applicability  of  fractional  tachniquas.  If  these  or  other  statistical 
techniques  are  found  to  be  lnappropriete,  the  fallback  position  will  ba  to  uaa  a  aet  of  "standard" 
soanarioa  raprasantlng  aolf-oonalatant  site  of  conditions.  These  scenarios  might  correspond  to  a  "worst 
case,"  a  "bast  case,"  and  an  "intermediate  caae"  and  would  ba  agreed  upon  by  the  sir  defame  community. 


Comment  by  Dr.  S.  H.  Starr,  Institute  for  Defense  Analyses,  400  Army  Drive,  Arlington,  VA  22202,  U.S.A.i 

Let  me  comment  on  the  overall  schedule  of  this  program.  Wa'rc  now  in  tha  process  of  doing  a  tait 
design  end  are  also  planning  tha  creation  of  tha  testbed.  Wa  anticipate  tha  simulation  to  ba  in  operation 
by  1982  and  concluded  by  19B4 .  Wa  are  aagsr  to  cooperate  with  other  interested  groups  euch  as  SHAPE 
Technical  Canter,  1AB0,  and  NFC. 


Comment  by  Mr.  A.  Bbmiach,  IAB0,  mbH,  Einateinstraase  20,  6012  Ottobrunn,  Federal  Republic  of  Germanyi 

Regarding  tha  modeling  of  communication  functions,  do  you  plan,  to  implement  avsnt-orlanted  quailing 
of  measagaa  as  affected  by  communication  protocols?  networking  (routing)? 


Author's  response) 

The  operetlonal  communication*  network  in  the  testbed  will  reproduce  the  connectlvitiee  and 
vulnerabilities  of  tha  actual  NATO  communication*  network.  Provisions  will  also  ba  included  to  establish 
the  proper  background  loading*  on  the  links  so  that  tho  communication*  delays  that  would  be  experienced 
under  wartime  conditions  will  be  emulated.  Feat-time  models  and  NATO  field  exercise  data  will  ba  uaad 
to  establish  the  valuss  of  the  statistical  measure*  of  thee*  delays  for  eubesquent  us*  In  the  testbed. 


_____ 


•'  . 


A-19 


Pmh  Mo.  26  (Mr.  Wundarllch) 


Constant  by  Mr.  H.  R.  Wilhalm,  STC,  F.O.  Box  174,  2501  CD,  Tha  Hague,  Netherlands: 

I  would  Ilka  to  axpraaa  ay  appreciation  for  this  interesting  preesntstion  on  your  model  which  will 
certainly  find  a  wide  application  in  the  futura.  However,  1  an  intrigued  by  your  conception  of  eecort 
fighters  letting  interceptor*  disengage  if  they  want  to,  and  in  this  way  let  the  interceptor  optimise 
their  effectiveness  (1,*.,  escort  fighters  cooperating  with  interceptors),  The  mission  of  escort  fighters 
is  to  engsgt  Interceptors  and  in  doing  so  distract  them  from  their  high  priority  targets — which  are  the 
escorted  aircraft.  By  letting  interceptors  disengage,  escort  aircraft  fall  to  perform  their  mission. 

In  this  context  1  have  several  questions .  Firot,  have  you  don*  any  studies  on  the  feasibility  of 
disengagement  taking  into  account  improved  firing  ranges  of  modern  air-to-air  missiles? 


Author's  response i 

This  is  a  tactical  question,  In  the  presentation  the  assumption  was  mads  that  blue  fighters  may 
leave  the  arena  under  the  condition  that  they  do  not  threaten  the  red  fighter-bombere  (FB'a)  any  more. 
In  this  case  it  doss  not  make  sense  for  the  escorts  to  engage  the  departing  blue  fighters  since  this 
increases  the  risk  to  the  escorts  tremendously  (hostile  environment,  ground-based  actions,  etc.).  So 
again,  in  my  opinion,  if  eacorta  accept  the  coubet  termination  offered  by  departing  blue  fighters,  they 
do  not  fall  in  solving  their  mission  but  minimise  their  own  risk. 

Regarding  tha  improved  firing  ranges  of  modern  air-to-air  missiles,  there  were  no  specific  studies 
dealing  with  this  subject.  The  disengagement  logic  is  always  active  and  in  this  cat*  (improved  firing 
range*),  is  influenced  by  incraaalng  passive  threat  values. 


Comment : 

Does  your  model  have  any  disengagement  logics?  And,  if  not,  do  you  intend  to  develop  these  logics? 


Author's  response i 

There  is  a  disengagement  logic  which  tells  the  aircraft  to  try  to  leave  tha  combat  if  possible  (1, a. , 
low  passive  threat  valuta)  in  case  of  shortages  in  armament  or  fuel. 


Comment i 

How  realistic  is  your  assumption  of  cooperative  behavior  of  two  opposing  forces? 


Author's  retponeel 

Escort  and  FB  are  cooperative  only  at  tha  beginning  and  in  the  first  phase  of  combat  as  shown  on 
the  flight  path  plot.  Once  the  eacorta  try  to  engage  the  blue  fighters,  they  "forget"  their  FB' a.  Then, 
if  an  escort  no  longer  has  an  opponent  snd  cannot  find  one,  he  returns  to  base.  This  seems  to  be 
realistic,  since  on  one  hand  after  an  alt  combat  the  escort  doss  not  have  the  chance  to  closa  up  to  his 
FB  again:  and  on  the  other  hand,  he  hat  not  enough  fuel  left  to  fulfill  his  escort  mission. 


Comment: 

How  could  the  idea  of  optimising  the  time  of  disengagement-- if  it  were  feasible-- be  implemented  in 
reality? 


Author's  response! 

This  could  be  don*  by  experience)  1,*,,  based  on  the  knowledge  of  performance  data  and  numbers  of 
aircraft,  the  leader  may  estimate  a  maximum  combat  time  or  an  allowable  loss-rate. 


Comment  by  Ir  N.  Van  Driel,  N.L.R.  Anthony  Fokkerweg  2,  1059,  CM  Amsterdam,  Netherlands! 
Which  kinds  of  sensors  ere  considsrud  and  to  what  leval  of  sophistication? 


Author's  response! 

The  following  sensors  are  included!  pulse  and  pulse  Doppl.er-radar  (STT/TWS)  i.o.,  multltarget 
capability),  RHAW,  FLIR,  HMfl,  pilot's  syos  (ona-half  person  per  A/C) ,  F.ach  sensor-model  simulates  the 
detection  process  in  a  moderately  sophisticated  manner  by  usin^  the  relevant  equations,  Example!  PI-XR 
takes  into  account  wavelength,  aerodynamic  heating,  plume,  power  setting,  rain,  etc. 
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Comment; 

Could  you  give  dome  Information  how  the  detection  proceee  la  modeled? 


Author*  ■  reaponiai 

The  iinaor  models  ara  handled  by  a  "ewltoh-pllot which  conalata  of  oertaln  algorlthna  which 
manage  the  "on/off"  of  all  aanaova.  Example! 

-  Red  hea  an  SOJ)  the  rad  aircraft  have  activated  all  paaalva  sensor*!  radar  ia  quiet  (in  order 
not  to  act  aa  a  "beacon"!). 

-  Blue  la  aearching  with  all  aenaora  (active  and  paaalva).  If  no  detection  occura  after  a  certain 
tlma,  then  radar  "off"  for  a  apacific  time.  Then  once  again,  "Radar  on  Search,"  etc.  Another 
example!  -  If  more  than  "x"  targata  are  within  vlaual  range,  then  radar  "off,"  and  rely  on 
FLIR/RHAW/HMS . 

There  are  move  algorithma  uaad  which  are  aimilar  to  theae  axamplee. 


Consent  by  Mr.  J.  H.  Powell,  Advanced  Projacta  Dept.  Brltleh  Aeroapace,  Warton  Aerodrome,  Praaton,  Lanca, 
United  Kingdom! 

What  account  doaa  your  model  taka  of  claaalflcatlon  tlmaa,  bearing  in  mind  that  engagement  may  be 
delayed  in  the  early  atagea  of  a  conflict  bacauae  of  the  possible  limitation*  of  not  opening  fir*  on  a 
target  which  haa  not  been  positively  identified? 


Author* a  raaponeai 

Up  to  now  there  ara  no  apacific  aubroutinaa  dealing  with  thla  subject.  IFF  la  taken  into  account 
by  varioua  time  delays  (sensor-dependent) . 


Paper  Mo.  27  (Cancelled) 


Paper  No.  28  (Dr.  Ruddy) 


Wo  comments. 


Paper  Wo.  29  (Mr.  Buiaaon) 


Wo  comments. 
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SESSION  VI  DISCUSSION 


Psnsr  No.  30  (Mr,  Bennlatar) 


Comment  by  hr.  M.D.  Rigby,  Aerodynamics  Dept.  British  Aerospace,  Aircraft  Croup,  Warton  Aarodout,  War  ton, 
Preston,  PR  4  1AX,  United  Kingdom 

With  reference  to  your  remark*  on  tha  limitation*  ancountarad  in  inplamlnelng  digital  solution  tech¬ 
niques  to  your  aircraft/oontrol  ayatam/avionlca  system  nodal*  In  term*  of  ltaratlon  tin*,  available 
atoraga,  ate.,  can  you  wake  any  connanta  on  any  araaa  In  which  solution  by  hybrid  computing  method*  night 
bs  mora  advantageous ,  if  you  believe  any  exlat? 


Author's  rasponas: 

While  w*  racogniia  tha  adventagaa  available  from  analog  computing,  particularly  in  terms  of  computing 
time,  wa  have  found  tha  flexibility  avnilabla  from  digital  computing  to  ba  attractive.  W*  have  approached 
tha  requirement  for  additional  processing  power  by  ualng  dedicated  microcomputer*  to  host  tha  Individual 
avionic  system  simulation*  and  connect  them  by  a  multiplex  digital  data  transmission  system,  much  aa  would 
ba  done  on  an  Individual  aircraft. 


Commantt 

Whan  faced  with  a  simulation  tank,  do  you  find  that  your  approach  tanda  to  ba  tailored  by  tha  type  of 
computing  facilities  already  available  to  you,  or  era  you  able  to  formulate  your  approach  to  tha  problem 
and  apnclfy  tha  typa  of  computing  facility  required  accordingly? 


Author 'a  rasponsei 

Of  coursa,  tha  approach  adoptad  always  has  to  consider  tha  resources  available.  However,  tha  us*  of 
a  modular  approach  using  microcomputer*  provides  u*  with  a  very  flexible  expansion  capability. 


Comtnantl 

Art  you  always  sura  thst  ths  output  from  s  much-*impliflad  simulation  model  la  a  valid  solution  to 
your  original  more  complex  model? 


Author' e  reeponaei 

Ae  indiaeted  In  the  paper,  the  level  of  complexity  of  th*  model  has  to  be  determined  by  the  Simula* 
tlon  objective*,  and  the  eimpleat  possible  model  should  be  adopted,  However,  I  agree  that  it  1*  neeensary 
to  b*  careful  not  to  ovar-»impUfy,  and  it  i»  important  to  examine  any  concluaion*  that  may  ba  drawn  from 
■lmulation  with  reapect  to  the  simplifying  assumptions  Included  in  the  model. 


Comment  by  Mr.  R.  Voles,  Panel  Member,  EMI  Electronic*  Ltd.  13!  Blyth  Road,  Hay**,  Mlddlaeox  UB3  IBP, 
United  Kingdom! 

In  view  of  the  continuing  ipectacuLar  reduction  in  the  cost  of  computing  and  in  the  light  of  the 
considerable  iucocrs  that  has  been  achieved  in  computer  ch***-pl,nying  packages,  is  it  not  time  to  start 
thinking  about  taking  a  mora  poaitlva  attitude  to  the  decision  rules  used  in  air-air  combat  and  to  svolva 
packagaa  which  will  gsnsrate,  ab  initio,  the  optimal  tactics  to  be  adopted  at  each  stage  in  multi-aircraft 

engagamants? 


Author's  response! 

Am  ie  implied  by  tha  question,  the  computing  time  required  to  explore  this  suggestion  is  extremely 
demanding.  We  understand  that  an  approach  has  boon  rnadw  in  tha  Unltsd  State*  to  applying  optimised 
tactics  at  an  elemantary  level  uelng  the  Theory  of  Carnes,  which  confirms  this  conclusion. 


Comment  by  Mr.  F.  S.  Stringer,  Psnel  Member,  Royal  Aircraft  Establishment  (R117  Bldg),  Famborough, 
Hants,  United  Kingdom! 


Have  yon  piano  for  the  considerotion  of  tha  assessment 
use  of  pairn  of  aircraft  operating  in  a  mutually  protective 


of  benefits  which  may  be  expected  from  the 
fashion,  even  in  terms  of  one-on-one  combat? 


Author's  response! 

The  development  of  the  tactics  routine*  which  are  very  important  in  aircraft  combat  modeling  has 
mainly  been  baaed  on  current  Air  Force  practice.  This  has  bsen  achieved  by  regular  discussion  with  setivs 
Air  Force  personnel.  We  accept  that  the  whole  question  of  cooperative  operations  in  close  combat  is  a 
controversial  one.  Our  own  view  is  that  coordinated  tactics  will  in  practice  rapidly  degenerate  into  e 


A-22 


series  of  one- on-on*  combat*  occurring  concurrently.  Thla  haa  bean  our  approach  to  data  although  v*  hav* 
not  pracludad  tha  pouslblllty  of  modallng  coordinated  tactic*  in  tha  future. 


?ao*r  No.  31  (Mr.  Ostaaard.  Presenter) 
No  comment*. 


iiM&JQi  a  flTt  MW) 


Comment  by  Mr.  H.  W,  Pongreti,  XABO  Abt  WTS,  Eins tsinattaai*  6012  Ottobrunn  B.  MUnchan,  Federal  Republic 
of  Germany i  ' 

In  our  alr-to-combat  aloulator  than  are  aavaral  microcomputers,  but  we  can  at  tha  moment  parallel 
no  more  than  about  three  machine*.  How  many  mlcroprocaaeora  do  you  think  you  can  put  in  parallel 
before  the  data-bua  become*  congested? 


Author'*  vaaponaat 

The  number  In  dependant  upon  tha  two  bua  data  ratal)  the  input  bua  data  rata  should  be  kept  ana 11 
or  multiplexed  to  group*  of  microcomputer* .  We  aae  the  output  extending  to  handle  2S6  microcomputers 
or  a  data  descriptor  rata  of  106  daacrlptors/aac.  The  basic  concept  Is  to  uaa  microcomputers  aa  "LEGCO'S" 
(or  "TINKER  TOYS")  to  construct  tha  moat  representative  configuration. 


Commant  by  Mr.  S.  Davy,  MOD  (UK)  St.  Andrew*  Road,  Malvam  Wore*,  United  Kingdom 

My  flrat  comment  concern*  the  suggestion  that  micros  era  equated  with  cheap  processing.  Tha  hardware 
may  ha  vary  cheap,  but  tha  coat  of  programming  la  not.  The  coat  of  filling  tha  IK  memory  with  debugged 
and  documented  coda  will  ba  around  $20K  If  using  a  high  level  language,  and  $100K  or  more  if  assembly 
language  la  used  aa  suggested  in  tha  paper. 


Author's  response i 

Coat  la  directly  related  to  tha  number  of  lines  of  tasted  coda.  My  pramlae  la  that  tha  number  of 
Unas  of  coda  will  ba  reduced  significantly  and  tha  coat  of  tasting  la  amall  for  tha  total  almulation  aa 
linear  auperpoaition  hold*  for  tea  tad  coda  used  In  adjacent  computer  unlta.  A  further  significant  coat 
advantage  la  through  tha  uaa  of  a  high  level  language  to  construct  a  scientific  modal  of  tha  simulated 
microcomputer  function  and  hence  to  a  tabular  or  logic  structure  suitable  for  loading  in  tha  target  micro¬ 
computer  aa  part  of  Its  operating  software. 


Comment l 

My  second  cement  1*  a  query  aa  to  tha  extant  to  which  the  reel  world  can  ba  adequately  represented 
by  parallel  autonomous  processes.  If,  for  example,  an  ESM  carried  by  an  aircraft  detects  a  radar,  than 
the  aircraft  may  wall  change  course,  resulting  in  a  change  of  aircraft  position,  ESM  output,  end  radar 
output.  When  closed  loops  Ilka  this  are  taken  into  account,  it  seams  to  ba  that  the  fraction  of  tha 
total  workload  which  can  b*  put  out  to  parallel  processing  la  vary  nmall. 


Author's  response) 

Tha  problem  of  representing  realistic  Interaction  between  a  moving  platform  and  an  array  of  emitter* 
la  a  suitable  problem  for  thla  parallel  microprocessor  approach. 


Comment  by  P.  M,  Uopp,  Induatriaanlagsn-Batriabsgeasllschaf t  rabH,  Studianabtailung  WTS,  8012  Ottobrunn  b. 
MUnchan,  Elnatainatraasa,  Federal  Republic  of  Garmanyt 

Our  experience  with  an  air  combat  flight  simulator  indlcataa  that  wa  can  have  not  more  then  three  or 
ao  mlcroprocaaeora  working  together )  otherwise  thay  are  assent ially  talking  to  each  other  instead  of  to 
our  simulator.  This  is  a  problem  we  ara  working  on  now. 


Author's  reaponaat 

Certain  problems  do  not  "map"  readily  into  this  structural  but  there  i*  a  large  else*  of  problem* 
that  do.  I  think  tha  ESM  problem  "maps"  very  well,  and  so  do  many  air  defense  modallng  problems. 


?W«g  So.  33  (Mr.  Oataaard) 


Comment  by  Ir  H.  Van  Oriel,  N.L.R.  Anthony  Fokkerwag  2,  1059,  CM  Amsterdam,  Netherlands : 

In  on*  o l  your  elides  tha  ASP  library  waa  nantlonad  aa  ona  of  tha  models  for  aircraft  simulation. 
Can  you  giva  intonation  on  which  parameters /nodala  you  ara  uaing  from  tha  ASP  Library? 


Author' a  raaponaat 

Tha  ASP  Library,  though  available,  la  currently  not  balng  uaad  tor  tha  simulation  involving  tha  Daia 
System.  Likewise,  tha  ASP  Library  haa  grown  ao  that  it  la  now  hoatad  on  tha  CDC  6600  Syet'aa. 

Paper  So.  34  (Mr.  Poncrata) 

Comment  by  Mr.  C.  M.  McLean,  Brltlah  Aerospace  Dyn arnica  Op.  Hat fie Id /Loa took  Div.  Manor  Road,  Hatfield, 
Hertfordshire,  United  Kingdom 

How  aignifioant  la  tha  acceleration  contribution  to  tha  accuracy  of  tha  prediction? 

Author1 a  raaponaat 

With  a  vary  maneuverable  target  thla  contribution  decide*  whether  you  hie  a  ''jinking"  target  or  not. 
Comment!  a 

la  tha  length  of  tha  computing  time  available  in  a  gun  firing  opportunity  aufflolant  to  permit  you 
to  make  aeneibla  aatimatee  of  target  acceleration  in  the  noiaa  environment  which  la  likely  to  occur? 

Author's  response i 

Tha  gradient  initialisation  phase  la  laaa  than  1  second.  This  should  ba  short  enough. 

Comment  by* Mr.  J.  H.  Powell,  Advanced  Projects  Dept.  British  Aaroapace,  Warton  Aerodome,  Preston, 

Lancs,  United  Kingdom 

What  validation  haa  bean  carried  out  on  the  model? 


Author' e  raaponaat 

The  model  hoe  been  axtenelvely  teeted  with  e  rather  detailed  radar  modal  off-line  and  on-line  even 
under  extrema  condltlona.  Thla  radar  model  was  validated  in  another  study  before  we  uaad  it  for  our 
ayHtem. 

A  teat  against  rsallty  using  a  low  targat  would  not  bo  practical  for  thla  haa  not  tha  manauvarabillty 
that  would  be  required  for  a  valid  test. 


Paper  No.  35  (Mr.  Bouthora) 


No  commente. 


Paper  No,  36  (Mr.  Schmidt) 


Comment,  by  Dr.  H.  A.  F.  Roefe,  National  Aaroapace  Laboratory,  NLR,  Vooritarwag  31,  Emmarloord, 
Netherlands  t 

X  assume  that  tha  actual  parformanc*  requiramenta  for  the  crulae  missile  are  classified  which  makes 
It  difficult  for  ma  to  check  your  result  aa  far  aa  tha  conclusion  is  concerned.  But  I  take  It  that  at 
leeat  you  concluda  that  you  do  not  naad  NAV  STAR  GPS' a  performance? 


Author's  raaponaat 

That  is  correct.  The  paper  doat  contain  some  details  for  tha  crulae  missile  navigation  aystetn  that 
ara  unclassified.  The  only  classified  information  haa  to  do  with  land  falls,  map  widths,  and  tha  like. 
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C  cement  by  Ir  H.  A.  I.  Tiacen,  Panel  Chairman,  Head  Blactronlca  Dapt.  N.L.R.  Anthony  Fokkerweg,  2,  1059, 
CM  Amsterdam,  Netherlands: 

An  inertial  system  la  aenaltiva  to  the  direction  of  flight.  There  ia  a  big  difference  in  error 
build-up,  especially  during  long  flight  time.  For  flights  from  eaat  to  Hast  and  west  to  east  the 
difference  la  vary  great.  Ia  this  effect  fully  encompassed  in  ycur  error  calculations? 


Author's  response i 

Tea,  it  la.  Resulta  for  heading  sensitivities  were  not  included  in  the  paper;  however  reference 
No.  7  contains  a  discussion  of  thosa  affects.  There  is  a  big  difference,  especially  at  the  longer  flight 
times. 


Comment  by  unknown  sourest 

What  is  the  gyro  modal  used  in  the  cruise  missile  alignment  filter? 


Author's  response! 

Actually  It  varied  anywhere  from  12  to  is  atatei.  Typically  it  includes  nine  states  for  ths 
inertial  ayatam,  two  for  the  duppler,  and  three  for  gyro  hisss. 


Paper  N«  37  (Mr.Erkalans) 

Comment  by  Dr.L.  Beck,  Standard  Electrik  Lorens  AO,  Dapt.  CN8/TWB,  Hellmuth-Hirth 

Strssse  42,  7000  Stuttgart,  40,  Fadaral  Republic  of  Germany! 

Bade  for  statistical  Only  3  pilots?  I  assume  not  enough  for  correct  interpretation 
of  ths  physical  efforts  of  pi lots  1 

Author's  response t 

I  agree  that  from  a  statistical  point  of  view  a  total  of  3  pilots  ia  small,  However, 
in  flight  tasting  and  simulation  one  ia  always  very  restricted  in  the  number  of 
subjects,  because  of  available  time  and  monay.  Apart  from  this  thara  was  a  subs¬ 
tantial  diffaranoa  in  background  and  experience  between  the  3  pilots.  Two  of  them 
ware  airline  pilots,  one  with  600  hours  experience  on  the  B747  end  one  with  150 
hours  experience  on  the  DO- 10.  The  third  pilot  waa  an  engineering  pilot  involved 

in  airworthiness  flight  tasting  and  with  a  total  of  330  hours  of  wide  body  aircraft 

experience . 

Comment  by  Mr.  B.L.  Dove,  Panel  Member,  Heed,  Avionica  Systems  Research  Branch,  Flight 
Electronics  Division,  NASA  Langley  Research  Center,  Mall  stop  477,  Hampton,  VA  23665, 
USAi 

Are  the  negative  results  you  obtained  in  simulation  attributable  to  the  display 
you  employed? 

Are  you  familiar  with  ths  Tsrminal  Configursd  Vshicle  Program  results  of  flight  tssting 
using  airline  pilots,  and  are  your  simulation  rssults  in  agreement  with  TCV  results? 

If  not,  why  not? 

Author's  response i 

As  pointsd  out  in  ths  writtsn  paper  the  pilots  did  not  use  the  pictorial  display 
frequently.  The  following  reaaenu  were  glvent-  the  approach  profiles  were  rather 
simple,  -  the  diaplay  had  been  situated  outside  the  scanning  range  of  the  pilots. 

The  results  of  this  simulation  largaly  agraa  with  the  automatic  flown  curved  approaches 
of  the  B737  TCV  of  NASA.  It  hat  to  be  taken  into  account  that  there  were  significant 
differences  between  the  simulator  end  the  TCV  instrumentation.  In  the  TCV  use  waa 
made  of  advanced  electronic  displays  (EACT  and  EHSI)  and  moreover  the  NLR  investi¬ 
gation  included  rather  worse  weather  conditions  (strong  sheers  and  low  cloud  base) . 

Comment  by  Mr.  F.S.  Stringer,  Panel  Member,  Royal  Aircraft  Establishment  (R177  Bldg) 
Farnborough,  Hanta,  United  Kingdom t 

Please  comment  upon  the  use  of  the  horizontal  diaplay  used  in  your  simulation.  Would 
thia  have  been  of  more  benefit  if  it  was  used  to  investigate  problems  of  ourvad 
approaches  during  partial  aystem  failure  or  for  the  investigation  of  reduced  ATC 
instructions. 

Author's  response i 

The  pictorial  display  would  have  been  more  beneficial  in  case  of  a  two  pilots 
operation.  The  pi lot-not-f lying  would  be  able  to  monitor  the  approach  on  the  diaplay 
up  to  tha  final  aagment.  Also  during  the  approach  path  interception  phase  this 
instrument  could  be  of  any  help.  AJ though  no  system  failures  hava  baan  considered  in 
the  investigation,  I  think  the  information  on  the  present  display  is  too  course  for 


use  as  primary  guidance.  Use  for  ATC  purpoaee  would  have  required  a  different  dieplay 
lay-out. 

Paper  No  38  (Professor  Daneal) 

Not  presented. 

Paper  No.  39  (Commander  Lane) 


Comment  by  Dr.  J.  Barrett,  Head  of  Helicopter  Diapiaye  Section,  Plight  Systems  Dept.  RAE,  Pamborough, 
Hants,  United  Kingdom 

Could  you  say  a  bit  mors  sbout  the  human  operator  modal  you  mentioned? 


Author's  raeponeei 

This  model  has  been  under  development  for  soma  time.  The  original  idea  was  conceived  over  10  years 
ago  by  Contender  Robert  Wherry,  USN.  It  is  baaed  on  a  detailed  task  analysis  of  pilot  end  crew  operations 
and  actions.  It  is  programmed  in  a  specially  developed  language  which  uses  a  combination  of  English 
and  FORTRAN i  FORTRAN  for  expressing  mathematical  aquations  used  to  describe  the  operator's  mental  pro¬ 
cesses  or  the  functioning  of  the  hardware,  and  English  to  describe  the  procedures  or  actual  steps  that  the 
operators  carry  out  in  flying  an  aircraft  or  performing  any  type  of  mission.  The  compiler  converts  these 
statements  into  a  form  that  can  be  utilised  by  the  simulator,  which  processes  these  statements,  aoceaaing 
certain  micro-models  for  information  absorption,  perception,  anatomical  movement,  short-term  memory,  etc. 
as  naaded.  These  micro-models  era  based  on  human  performance  experiments  reported  in  the  literature.  The 
simulator  then  generates  a  time-line  for  the  operator's  parformanoa.  An  output  processor  than  generates 
statisticel  data  based  on  the  statistical  characteristics  of  an  average  trained  operator.  Information  on 
the  modal  is  readily  available  in  the  literature. 


Comnant  by  Mr.  J.  H.  Powell,  Advanced  Projects  Dept.  British  Aerospace,  Warton  Aerodome,  Preaton,  bancs, 
United  Kingdom! 

Utility  and  cost  functions  are  difficult  to  assign  to  any  operational  task.  How  sensitive  are  your 
qualitative  results  to  your  assignments  of  the  utility  functions? 


Author's  response! 

The  results  appeared  to  be  far  more  sensitive  to  the  tactics  used  in  our  simulation  than  to  tils 
assigned  utilities.  It's  very  difficult  to  obtain  utilities!  assignments  of  utilities  need  to  be 
explicitly  stated  by  a  higher  authority,  end  we  are  advocating  this. 


Cotwnent  by  Mr.  J.  0.  Wohl,  Program  Chairman,  The  MITRE  Corporation,  P.  0.  Box  20B,  Bedford,  MA 
01730,  U.S.A.  i 

Tfou've  aggregated  a  number  of  micro-models  of  Human  cognitive  and  motor  performance  into  a  large- 
scale  model  purporting  to  reflect  total  human  performance  in  a  task.  Hsu  it  been  validated  againat  a 
number  of  trained  operator*)  performing  real  tasks? 


Author's  response i 

Tea,  in  limited  circumstancoB  it  has  been  validated  againat  a  number  of  tanka. 


Paper  No.  40  (Dr.  Linton) 


No  comments. 
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